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ABSTRACT 


The trend of foeusing on teehnology in “teehnology augmented environments” 
and practieing a set of skills in isolation needs to shift towards user-eentered training with 
skills being integrated earlier in the training proeess, as long as eonditions for that 
integration exist. The purpose of this thesis was to examine whether incorporating 
intelligence briefs and debriefs with a Squad Planning Operations Center (SPOC) 
supported by suitable technologies improved infantry training in urban warfare training 
situations. To prepare for this task, a pilot study was conducted following current Infantry 
Immersion Trainer (IIT) procedures for the control group, while the experimental group 
utilized an Augmented Combat Operations Center (A-COC). Information gained from 
this study was then utilized for the main study conducted at the IIT aboard Camp 
Pendleton, CA. This study was conducted utilizing sixty participants in the control group 
(following current IIT procedures) and ninety-three participants in the experimental 
group (IIT procedure augmented with the use of a SPOC). The most statistically 
significant difference between the groups came from the participants’ self-assessment on 
training confidence and overall success of training. Members of the experimental group, 
after utilizing the SPOC for planning, felt more confident in completing their training 
tasks and their view of achieving success in executing their mission was also higher. 
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I. INTRODUCTION 

A. BACKGROUND / MOTIVATION 

In October 2007, under Marine General James Mattis’ guidanee, the U.S. Marine 
Corps (USMC) and the Office of Naval Researeh (ONR) unveiled a $1.3 million 
prototype Infantry Immersion Trainer (IIT) aboard Camp Pendleton, CA (Babb, 2007). It 
was eonstrueted to improve Marine Corps eombat skills aeross a wide range of military 
operations, with emphasis being on supporting squad training in an urban environment. 
Training seenarios ereated for this environment involve the tasks in an urban 
environment, room elearing, urban patrolling, reaetion to sniper fire and Observation 
Point (OP) aetivities. 

Designing an effeetive training framework and providing an optimal solution for a 
given training objeetive and training environment while developing high performing 
teams is a signifieant issue for military leadership (Knight). Aeeording to Katzenbaeh and 
Smith (1998), a team is defined as “a small number of people with eomplimentary skills 
[...] eommitted to a eommon purpose, performanee goals and approaeh [...]” Western 
military taeties show the major advantage of teamwork is that teams often aehieve a high 
sueeess rate where individuals often fail. 

The military is very foeused on building teams at the squad leader and fire team 
leader levels. Eaeh of these leaders must prepare their teams for missions in remote areas 
with the potential for possibly quiek ehanges to their situation; as deseribed by retired 
Marine General Charles Krulak in the 1990s as the Three Block War. For example. 
Marines may be required to eonduct full-seale military action, peacekeeping operations 
and humanitarian relief within the space of three eontiguous eity bloeks (Krulak, 1999). 

Through effeetive patrolling on the battlefield, military forees ean gain an 
advantage over the enemy by establishing a means of eommunieation with the loeal 
population and gaining intelligenee about enemy aetivity and loeal population eoneems. 
The loeal population ean provide a wealth of information, whieh ean ensure support for a 
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mission accomplishment. However, to build an effeetive relationship with the loeal 
population, squads must be trained in patrolling and interaeting with the loeal populaee. 

Training is essential for teambuilding among squads and for developing the 
individual skills required to beeome sueeessful at patrolling (Marine Corps Warfighting 
Publieation (MCWP) 3-11.3). Patrol members must work together and fight as a team 
(MCWP 3-11.3), whieh ean be ehallenging for the squad during their training due to the 
different levels of expertise. Training at the IIT could address and assist in developing a 
multitude of skills identified for learning the skills neeessary for effeetive patrolling. 
These skills do not always involve fighting the enemy. Urban patrols must interact with 
the loeal populaee, eolleeting Human Intelligenee (HUMINT) about the loeal 
atmospheries and enemy related activities; eaeh unit member needs to be fully trained 
and engaged and direetly supporting the strategy of “every Marine eolleetor, every 
Marine reporter.” Marines also must remember the vast majority of the individuals with 
whom they eome in eontaet will be noneombatants attempting to survive in trying 
politieal, eeonomie, and soeial situations (MCWP 3-11.3). 

To support and achieve previously stated objeetives, the state of the art training 
has being developed at the IIT ineludes Computer Generated Actors (CGAs) or rather 
agents like those seen in Figure 1, representing human eharaeters/virtual humans (Hoyt et 
ah, 2003). Agents are eommonly defined as graphieal representations eontrolled by the 
human operators or being eompletely autonomous while reaeting in real time. In present 
eonfiguration of IIT training faeility, the images of virtual humans are displayed on flat 
walls inside eight separate rooms. The primary purpose of these graphieal representations 
is to augment the presenee of live role players who are not intended to be used for target 
engagement, and to provide the user with a sense that there is someone else present with 
them in the virtual environment (this is often referred to as a sense of eo-presenee (Hoyt 
et ah, 2003)). The more realistie these virtual humans act, the higher is a level of eo- 
presenee (Casanueva & Blake, 2001). 
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Figure 1. Graphical representations of human characters, known as avatars or virtual 

humans. 

The downside to using these computer-generated actors (CGAs) is that these 
human-controlled actors are costly in terms of hardware, software, and human resources 
needed to support them (Stytz et ah, 1998). To date, CGA systems have proven to be 
expensive to implement, expensive and challenging to modify, and lacking in realistic 
behaviors (Stytz et ah, 1998). Because the Marine Corps is moving toward infantry 
immersion training, approaches to mitigate costs associated with current CGA 
implementations are needed. To minimize costs, the IIT utilizes a single computer host 
inserting a number of CGAs of various types into the environment and coordinates the 
activities of the agents. However, the costs of having the real role players (humans) may 
be even higher. Their presence adds to the sense of “being there,” and they make the 
training more realistic and believable. Human role players can fully interact with the unit; 
they can satisfy a number of tasks that the virtual humans are not capable of supporting 
like conversing with the unit members, searching, detaining, physically interacting with 
the unit members (pulling the arms of the Marines as to distract them), acting as a 
casualty, and physically interfering with the course of action.. 

Another impressive aspect of the immersive training is the blast experience of an 
Improvised Explosive Device (lED) or Vehicle Born Improvised Explosive Device 
(VBIED) that can be programmed to detonate nearby, a rocket-propelled grenade (RPG) 
being fired overhead, or Small Arms Marking System (SESAMS) round being fired at a 
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person by an adversary. For those who have engaged in eombat and for those who have 
not, this kinetie training at the IIT ean cause strong psychological emotions often 
experienced during an actual firelight. 

As great as this training setup is, it can still be improved. Our motivation is to 
plan a way to build upon the current form of training at the IIT. In our view, current 
training is too technology centered—the emphasis is on instrumented elements of the 
training range, and the training scenarios as well as training approaches are built around 
the technical features provided in this facility. This thesis will present a training process 
that will emphasize a true integration of intelligence skills. The current trend appears to 
be a rush to engage in a firelight when, in all reality, patrolling efforts can only begin 
with intelligence and must end with input into the intelligence cycle for the next patrol to 
go out. 

B. PROBLEM OVERVIEW / RESEARCH QUESTIONS 

Across the Marine Corps, the infantry squad leaders of today lack an accessible 
simulation center for training their squads for their first firelight. These virtual combat 
experiences would prepare fire teams and squads to accomplish the mission by 
integrating individual and fire team tasks at the squad level. The simulation center must 
be cost effective and robust enough to create a virtual environment that replicates the 
asymmetrical battlefield military faces today. 

The majority of casualties on the battlefield are from the combat arms fields— 
89%. Only 0.1% of Department of Defense simulation funding is spent on infantry 
simulation. The people working in the aviation domain have realized that virtual training 
simulations save lives and preserve precious resources (maintenance and logistical costs 
for the plane, fuel, parts). The practitioners in the ground domain have also realized that it 
is the time to invest in ground combat simulation—for both immediate and long-term 
benefits. The Marine Corps needs the world-class simulations to support training for the 
combat arms Marines (U.S. Marine Corps, 2008), and the needs of the infantry combat 
elements are even more pronounced in contemporary warfighting. 
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The result of our observations and domain analysis suggest that the training at the 
IIT, even though highly advaneed during the aetual training run, makes no use of 
information teehnology during its briefings. In order to remedy this situation and eonneet 
unit notions inside the simulated village with the intelligence activities, they will be 
expected to do in the operational theatre, we established an idea of a briefing area which 
presents the mission to the squad and fire team leaders in a realistic and understandable 
format similar to what can be expected when deployed in operational theatre. The 
intelligence collected during the previous training session (a scenario) should be 
presented to the patrol leadership for their planning. This intelligence input can then 
generate their planning efforts for rehearsals and their confirmation brief before 
conducting the patrol. This same briefing area could then be used for the After Action 
Review (AAR) and patrol debrief. Information gained from this process would then be 
utilized to generate the follow-on patrol scenario, completing the loop in the intelligence 
cycle and driving a patrol order for the next mission. 

It is our aspiration for Marines conducting their training patrols within the IIT to 
radio back with situation reports to a Squad Planning Operations Center (SPOC). We also 
envision the patrol debriefs being conducted by the company-level intelligence cell 
(CLIC). The CLIC will then use their computers and accessible data files to analyze the 
information collected to create an intelligence picture of the battlefield. To support this 
level of understanding, intelligence products can be generated to visualize the data 
previously collected. These intelligence products will then be the source to drive the 
patrol order issued through the squad’s leadership within the company-level operations 
cell (CLOC). 

Unfortunately, at present time, most pre- and post training briefings are conducted 
in a yard outside the IIT. Even though the majority of teams arrive as a pre-trained unit at 
the IIT, it is hypothesized that improvement in the team briefing processes may result in 
stronger team cohesion, and serve as a necessary reminder of the tasks that need to be 
accomplished to support and fully integrate intelligence activities in their operations. 
Information technology equipment in a SPOC that is introduced in this thesis is used to 
enhance the briefing experience as well as the team’s interaction prior to and after 
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conducting their training run inside the environment. This way teams will get a better 
understanding of their individual objeetive and experienee a higher interaetion. They will 
experienee different team proeesses, resulting in a higher performanee than without the 
use of a SPOC. It is also important to note that the addition of the SPOC and the aetivities 
that it assumes do not represent a burden on training in IIT—they are a logieal extension 
of that training, both in terms of supporting the training objeetives envisioned for IIT as 
well as eorresponding very well with the point in the training regiment that the units are 
in when they eome to IIT (right before their pre-deployment training segment in 
Twentynine Palms, CA). 

1. Hypothesis 

Two following hypotheses were set as a result of our domain analysis: 

HO (Null hypothesis): There is no differenee in squad performanee and team 
interaetion between the squads reeeiving very short briefings in the yard outside the IIT 
and those being briefed using the speeially designated SPOC. 

HA (Alternative hypothesis): Teams reeeiving the well struetured pre- and post- 
aetion briefings within the SPOC will experienee different team proeesses resulting in 
higher performanee and display higher team interaetion than those who reeeive very short 
briefings outside the IIT. 

2. Approach: Experimental Studies 

This thesis set out to examine whether ineorporating the well-struetured 
intelligenee briefs and debriefs within a SPOC, supported by suitable teehnologies, 
improved the training that was eondueted within an infantry immersion training 
environment. To examine this hypothesis, two studies have been designed and exeeuted: 

(1) a pilot study and 

(2) a main study. 

The goal of the pilot study was to generate starting knowledge and build the 
expertise in organizing and exeeuting the user studies, and eonduet an initial testing of 
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the hypothesis, all with the goal of helping plan the main study that will involve real 
(eombat) units while they are preparing for their future deployment. The pilot study was 
eondueted utilizing six fire teams that were equally divided into a eontrol group and a 
treatment group (utilizing an Augmented Combat Operations Center (A-COC)). The 
participants consisted of twenty-three entry-level military personnel (both male and 
female) who completed self-report questionnaires and were under direct observation by 
an evaluator. Information and experience gained from this first study was then utilized to 
design a second study, (i.e., the main study, which lasted two weeks at the Infantry 
Immersion Trainer (IIT) aboard Camp Pendleton, CA). The goal of the second study was 
to obtain the data in a relevant training environment that would help us test our main 
hypothesis. This second study was conducted utilizing sixty participants in the control 
group (following current IIT procedures) and ninety-three participants in the treatment 
group that used a SPOC. The participants completed self-report questionnaires and were 
under direct observation by multiple evaluators. Chapters VI and VII provide detailed 
information about both studies, including a discussion of their results. 
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II. IMMERSIVE ENVIRONMENTS 


A. BASIC CONCEPT 

Immersion is defined as instruction based on extensive exposure to surroundings 
or conditions that are native or pertinent to the object of study (Merriam-Webster Online 
Dictionary, 2009). In domain of virtual environments, Slater and Usoh (1994) explain the 
term immersion as a description of a technology, which can be achieved to varying 
degrees. A necessary condition is Ellis' (1991) notion of a virtual environment (VE), 
maintained in at least one sensory modality (typically the visual). Eor example, a head- 
mounted display with wide field of view, and at least head tracking would be essential. 
The degree of immersion is increased by adding additional and consistent modalities, 
greater degree of body tracking, richer body representations, decreased lag between body 
movements and resulting changes in sensory data, and so on. 

Research studies done in domain of virtual environments suggest that immersion 
may lead to a sense of presence. Presence is a psychological emergent property of an 
immersive system, and refers to the participant's sense of "being there" in the world 
created by the VE system. Note that immersion is a necessary rather than a sufficient 
condition for presence—immersion describes a kind of technology, and presence 
describes an associated state of consciousness (Slater & Elsoh, 1994). 

There are many possible ways to create an immersive environment, and each way 
will contribute towards enhancing a sense of “being there” for the user. “Being there” can 
be stimulated by the sights, sounds, touch, smells, tastes which the user experiences. This 
experience of “being there” is known as “Personal presence.” Presence is knowing the 
illusion is not true, but behaving like it is true (Casanueva & Blake, 2001). 

Witmer and Singer (1998) provide the following about the meaning of presence; 

• “Presence is defined as the subjective experience of being in one place or 
environment, even when one is physically situated in another.” 
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• “...presence refers to experiencing the computer-generated environment rather 
than the actual physical locale.” 

Witmer and Singer’s (1998) view of immersion also relates to understanding the 
meaning of presence: 

• “Immersion is a psychological state characterized by perceiving oneself to be 
enveloped by, included in, and interacting with an environment that provides a 
continuous stream of stimuli and experiences.” In several papers (see references cited in 
Slater & Wilbur, 1997) Slater (1999) has employed the notion that presence includes 
three aspects: 

• “The sense of “being there” in the environment depicted by the VE.” 

• “The extent to which the VE becomes the dominant one (i.e., that participants 
will tend to respond to events in the VE rather than in the “real world.”)” 

• “The extent to which participants, after the VE experience, remember it as 
having visited a “place” rather than just having seen images generated by a computer.” 

Eor this thesis, our working definitions of immersion and presence are as follows: 

1. Immersion —a degree to which human sensory system is provided 
with alternative (simulated) sensory information. (Example: desktop 
systems are less immersive, while large screen and CAVE environments 
are more immersive). 

2. Presence —^user's psychological sense of being in an environment 
that is different than his/her immediate physical environment. 

B. CATEGORIES OF IMMERSIVE ENVIRONMENTS 

I. Desktop Environment 

Not all simulation technologies require visualization on a large display surface 
nor do they require full-body human interaction. They can run on a desktop computer 
using only a screen of a regular size, a mouse, and sometimes a microphone and the 
loudspeakers for audio inputs and outputs (Eigure 2). The participant can act as a sole 
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player, or he/she can interact with other participants, ask questions or give orders by 
typing or speaking directly, or make comments and report on what he/she can observe by 
viewing the data and images presented on the computer monitor. 


A more advanced variation of this approach allows multiple participants to 
interact simultaneously in a common “virtual world,” linked either through the Internet or 
a dedicated network. As the users navigate (move) through the synthetic environment, 
typically they are presented with a series of 2D projections of 3D model of a shared 
world. Each participant has an “avatar” that represents their persona in the virtual world. 
They can move the avatar, and when they speak or gesture, the avatars will appear as if 
they speak or make gestures. This is initiated by the users themselves—they provide 
direct “instructions” to their avatars by using a special combination of the buttons on the 
mouse or on the keyboard, each associated with a type of behavior that needs to be 
presented and visualized to the others. It is also possible to simulate the interaction 
between two or multiple avatars. 



(a) An individual using desktop simulation. 


(b) A group using desktop simulation. 


Figure 2. Participants using desktop simulations. 


Some desktop systems currently in use by the USMC: 

a) Close Combat Marines (CCM); The Marine Corps has been leveraging 
aspects of digital-game based methods and inserting them into the tactical 
decision-making simulations (TDSs) to supplement existing training 
(Baxter, Ross, Phillips, Shafer, and Fowlkes, 2004, p. 1). The Marine 
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Corps currently uses a TDS named CCM at various leadership and tactical 
training schools. This TDS provides a top-down view of the battlefield (a 
type of 2 14 dimensional environment) and it was designed to develop the 
tactical decision-making skills of entry-level officers (Fitzpatrick & limit, 
2007). 

b) Forward Observer PC Simulation (FOPCSIM) is a procedural trainer 
for artillery and mortar Call for Fire (CFF) that provides scoring and 
feedback based on the standards of performance prescribed in the Training 
and Readiness Manuals for observed fire. FOPCSIM is also the forward 
observer eomponent of the Deployable Virtual Training Environment 
(DVTE) Combined Arms Network (CAN) that provides a training tool for 
integration of artillery and close air support with maneuver forces. 
EOPCSIM uses a 3D visual representation of real world terrain (ineluding 
MCAGCC, Tikrit, Iraq, et al.) and an intuitive user interface to provide a 
training environment for doctrinal CEE procedures. EOPCSIM 2.1.14 is 
software written by Marines for Marines and is available free of charge at 
the Battle Simulation Center. With user registration, EOPCSIM 2.1.14 
may be downloaded from www.foposimmarines.oom (MAGTETC 
Simulation Center (BSC) FOPCSIM, 2009). 

o) Virtual Battle Space (VBS) 2 is the latest generation of taotical decision 
simulation for the USMC. VBS2 was fielded in the third quarter of EY- 
2007 and features higher visual resolution, fully articulated human 
movements, interaction with inanimate objeots (piok up, load, move, dig, 
eto), and High Eevel Arohitecture (HEA) oompliance for the ability to 
network VBS2 virtual training with oonstructive simulations, such as Joint 
Semi Automated Eorces (JSAE), Joint Conflict and Tactical Simulation 
(JCATS), or MAGTE Tactical Warfare Simulation (MTWS), used for 
staff eommand post exereises (MAGTFTC Simulation Center (BSC) 
VBS2, 2009). 
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d) Tactical Iraqi Language and Culture Trainer (TILCT) differs from 
commercially available language training software in that it focuses in the 
vocabulary and circumstances of interactions between Marines and Iraqi 
citizens in the context of the operational environment. Lessons cover the 
language and conversational skills necessary for a variety of situations 
from basic introductions and explaining the mission and duties of a guest, 
to conducting a cordon and search. TILCT introduces new material in a 
Skill Builder format that includes hearing the spoken word by a native 
speaker, phonetic pronunciation, and the use of a microphone to practice 
speaking with immediate feedback on performance from speech- 
recognizer software (MAGTFTC Battle Simulation Center (BSC), 
Tactical Language & Culture Trainer (TLCT), 2009). 

2. Fully Immersive Environment 

A fully immersive environment inoculates individuals with a multitude of sensory 
information that completely surrounds them to experience the sensations they would 
expect to feel if the situation were for real. Ideally the participants will experience 
sensation through each of their five senses (i.e., see, hear, smell, touch and taste.) while 
being completely enveloped by the sensory information presented to them, creating an 
illusion of a new world for the participants. The more the sensations trigger a familiar 
response to the individual, the more likely the participant will accept the immersive 
environment as though it were real. The increase in acceptance by the participant adds to 
the participant’s positive experience of personal presence. Figure 3 (a) shows a person in 
a helicopter simulator using physical controls of a typical helicopter and surrounded by 
vivid images. Figure 3 (b) shows a Marine using the Virtual Combat Convoy Trainer 
(VCCT)—a mock-up vehicle surrounded by the large, continuous displays that fdl his 
field of view with synthetic images. 
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(a) An individual using a helicopter simulator. (b) An individual using a VCCT system. 
Figure 3. Participants using immersive simulators. 


Another training segment that can be characterized as immersive training takes 
place at the U.S. military’s three-week course in the Survive, Evade, Resist, Escape 
(SERE) school. Through an immersive environment, this course “inoculates” individuals 
to stressful situations they might encounter if taken prisoner. The instructors go as far as 
to simulate opposition gunfire while hunting the soon-to-be prisoners. Once taken 
captive, the participants face sleep and food deprivation, exploitation, singling-out of 
individuals for punishment, removal of identities and aggressive interrogations. Major 
General James W. Parker (EISA) wrote in 2006 that “CW4 [Chief Warrant Officer 4] 
Mike Durant [USA] credited SERE training with saving his life when he was captured in 
Mogadishu in 1993” (Parker, 2006). 

In his book. In the Company of Heroes, retired 160th Special Operations Aviation 
Regiment pilot CW4 Mike Durant (Durant & Flartov, 2003, pp. 100-109) reflected on the 
SERE training he received at Camp Mackall in the winter of 1988 and the strength it gave 
him during his 11-day captivity in Somalia in October 1993: 

I came away [from SERE] with tools that I never believed I would ever 
really need, but even in those first seconds of capture at the crash site in 
Mogadishu, those lessons would come rushing back at me. Throughout my 
captivity, I would summon them nearly every hour ... I thanked [Colonel 
Nick Rowe (USA), who is credited with developing the rigorous SERE 
training program] silently every day in Mogadishu, and I asked that God 
bless him, as I tried to plan my next move. 
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CW4 Durant’s words speak volumes on the signifieant impaet the immersive SERE 
training imparted on him. 

Some immersive systems eurrently in use by the EiSMC: 

1) The Virtual Combat Convoy Trainer-Marine (VCCT) is an immersive 
virtual environment simulation trainer for eonvoy missions and HMMWV 
mounted patrolling (Eigure 3.b). The VCCT ean aeeommodate 30 Marines 
in six simulated HMMWVs. The six vehieles are networked together into 
a 3D virtual environment where the unit ean train as a team in eomplex 
taetieal situations. Training in the VCCT is seenario based and eondueted 
in bloeks of four hours. The Utility uniform with individual proteetive 
equipment (PPE required to train in VCCT to inelude Elak, Kevlar, and 
another PPE required by unit).and 782 gear is the uniform for training 
(MAGTETC Simulation Center (BSC) VCCT, 2009). 

2) The Operator Driver Simulator (ODS) is a high fidelity immersive 
teehnieal skills trainer for teaehing Marines how to safely drive several 
vehieles in the USMC inventory. Those vehieles inelude the HMMWV, 
the MTVR 7-ton truek, and the MRAP Cougar. The ODS provides 
realistie haptie feedbaek to the student through the steering wheel, pedals 
and dashboard eontrols that replieate the experienee of driving an aetual 
MTVR. The ODS also models the effeets of wind, temperature, 
preeipitation, traetion, tire pressure, and road surfaee on the handling 
eharaeteristies of the vehiele. Throughput for sustainment training driving 
seenarios is approximately three or four Marines per hour. The ODS ean 
aeeommodate two drivers at the same time with two observing Marines 
plus the instruetor in the simulator with one student driving while the 
others observe from the Instructor Operator Station until it is their turn to 
drive (MAGTETC Simulation Center (BSC) Operator Driver Simulator 
(ODS), 2009). 

3) The HMMWV Egress Assistance Trainer (HEAT) is a mechanical 
simulation trainer that familiarizes Marines with the techniques and 


15 



procedures for egressing a HMMWV that has overturned. It is not a 
rollover trainer in the sense that it does not replieate the inertial forees 
experieneed by the erew of a HMMWV during a erash. It is a training tool 
for learning how to safely exit a vehiele and evaeuate wounded after the 
vehiele has overturned. Training in the HEAT progresses from simple 
seenarios in whieh all oeeupants are uninjured to more eomplex 
eireumstanees in whieh one or more of the oeeupants are wounded and 
potentially uneonseious. As a planning faetor for throughput, 
approximately 16 Marines per hour, per HEAT deviee. Required PPE 
ineludes: flak, kevlar, gloves, eye proteetion, knee and elbow pads 
(MAGTETC Battle Simulation Center (BSC) HMMWV Egress Assistance 
Trainer (HEAT), 2009). 

3. Augmented Environment 

An augmented environment deals with the eombination of real-world and 
eomputer-generated data (virtual reality), where the eomputer graphies objeets are 
blended into the real (physieal) world of the user and the user not needing a speeial 
deviee (eye gear) to experienee this mix. Another type of environment ealled augmented 
reality (AR) is eoneemed with the use of simulated video imagery being superimposed to 
the real world while they are both pereeived by the user while he/she is looking through 
speeial glasses; the eombination of real and virtual world exists only inside the glasses, 
unlike in augmented environments when that mix is more direet and ean be seen with a 
naked eye. The augmented reality researeh also ineludes the use of motion-traeking 
sensors, as to be able to traek user’s head position and orientation and adjust the synthetie 
images presented to the single user eorreetly. The augmented environments have no need 
for sueh a traeking system; however, the projeetion of the virtual eharaeters images will 
not be eorreet for every user (it will be eorreet only for the user that is very near the 
physieal point used as a viewpoint when ealeulating a 2D projeetion of 3D synthetie 
world). 
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Some augmented environments currently in use by the USMC: 

• The Indoor Simulated Marksmanship Trainer—Enhanced (ISMT-E) 
and the Infantry Squad Trainer—Enhanced (IST-E) are two 

dimensional (2D) simulation (i.e., it shows a real image (photograph) with 
(sometimes) superimposed images of the targets) based trainers for indoor 
use, capable of instructing in basic and advanced marksmanship, shoot/no¬ 
shoot judgment, combat marksmanship, and weapons employment tactics. 
The trainer consists of an Instructor Station, audio/visual system, and 
weapons firing positions. Each firing position is capable of operating 
simulated weapons that includes simulated AT4, M2 (.50 cal), M9, M16s, 
M240G, M203, MK19, MP5, Squad Automatic Weapon, M870 12 gauge 
shotgun. Shoulder launched Multipurpose Assault Weapon, M224 60mm 
Mortar, M252 81mm Mortar, M4s, Short Range Anti-tank Weapon 
(Predator), and Joint Services Combat Shotgun. The ISMT-E has four 
firing positions. The IST-E consists of three ISMT-E trainers connected as 
a single system providing fifteen firing positions. A large display device 
provides simulated targets. The simulated weapons fire upon the simulated 
targets with an indication of the round fired provided as feedback. The 
Instructor Station controls the training and provides feedback of the 
results. ISMT-E/IST-E devices also provide Eorward Observer 
Spotting/Control of indirect fire and night vision training capabilities in 
addition to the baseline combat and marksmanship training features. 
Additionally, the ISMT-E provides night vision and optical training for 
various weapon sights (both magnified and non-magnified), NV devices, 
and aiming lights. The optics training feature wireless weapon simulators 
and is focused on M16A4, M4A1, M203, M249G, and M240G weapon 
systems (U.S. Marine Corps Concepts & Programs, 2008). See Eigures 4 
(a), (b) and (c) for a visual depiction of the ISMT. 
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(a) Indoor Simulated Marksmanship (b) ISMT - Enhanced. 
Trainer. 




(c) ISMT with a trainee and synthetic environment 
as a target. 

Figure 4. Images of ISMT system. 


• The Infantry Immersion Trainer (IIT) is an adaptive, interactive trainer 
focused on the infantrymen who require honed rifleman skills. Immersive 
training inoculates Marine rifleman into the chaos and confusion of 
irregular warfare, and in particular urban battle, to the extent that Marines 
will have experienced the real demands of combat in a mixed reality and 
simulated environment. The end state is Marines better trained to make 
moral, ethical and legal decisions on the battlefield (U.S. Marine Corps, I 
Marine Expeditionary Force, 2009). To stimulate the vision of the 
participants at the IIT, a technology known as FlatWorld is used (Figure 
5). FlatWorld system uses high-performance PC graphics accelerators to 
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generate synthetie images and digital projeetors to display them onto the 
walls; both set of deviees are available at affordable priees and 
predominantly off-the shelf solutions (Pair & Peipol, 2002). These are the 
eharaeteristies that make the system a very desirable training tool for 
Marine infantry units. Combined with the sounds and smells assoeiated 
with the images presented on the flat walls, the participant will likely 
experience a sense of presence for the situation presented to him/her. More 
details can be found in the subsequent chapter (Chapter III). 



Figure 5. An example of augmented environment: Infantry Immersion Trainer (IIT). 

Yuhas et al. (2008) provide their vision for the future of infantry immersion 
training: 

a) An order is received to execute a mission in an area of operations urban 
battlefield environment. The mission is plaimed on a joint mission 
plaiming system and courses of action are electronically rehearsed on a 
pre-mission rehearsal system that recreates the nuances of the lines of 
communications, avenues of approach, and objective area. Supporting 
arms, casualty evacuation, and communications tactics, techniques and 
procedures are reviewed and rehearsed. 
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b) The infantry squad enters a hyper-realistic recreation of the battlefield 
environment—physically, visually, aurally, and aromatically. Mission 
actions are carried out through interaction with virtual and live entities that 
will interact with and to the actions of the live infantry squad. The squad is 
required to interact partially in the native language, to be knowledgeable 
of, and correctly demonstrate cultural norms and nuance. 

c) The mission situation will set the rules of engagement, allowing combat of 
varying intensity. The infantry squad will encounter differing situations, 
from patrolling to intense urban combat. The squad will call for mortar, 
artillery, naval surface, and aviation fires. The squad will request 
reinforcements. The squad will request medical assistance to include 
surface borne and aviation medical evacuation. 

d) The squad will conduct an attack, an attack of a building, and an attack of 
a fortified position. 

e) Upon completion of the mission exercise a video/aural capture system will 
be used to conduct an after action review of all elements of the squads 
mission performance. The system captures and correlates each squad 
member’s actions to produce an individual or collective event-by-event 
review of the entire mission. A recorded piece of media is made available 
to the squad to review after the scheduled after action review. 

An example of an Augmented Reality system currently in use by the U.S. military 
is the Chromakey Augmented Virtual Environment (ChrAVE). It was originally 
prototyped by USMC H-53 pilot Mark Lennerton as a cheap and portable way to turn any 
vehicle into an interactive trainer. Combining a PC running a navigational application 
with a head-mounted display and a bluescreen, ChrAVE was field tested at HMM(T)-164 
and validated for providing an effective overland navigation training system, a test 
platform for NVG simulation, and a realistic out-the-window view in a deployable, 
immersive system (Naval Postgraduate School, 2005). 
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C. PAST STUDIES 

A sizable body of research suggests that simulation-based training is generally 
superior to conventional training methods: 

a) Wolfe (1997, pp. 360-376) examined a variety of studies on simulation- 
games to teach strategic management, from the 1970s to 1997. His 
conclusion? “Ample evidence has been presented authenticating the 
effectiveness of computer-based general management games as 
vehicles for teaching strategic management. In every study cited, the 
particular business gaming application produced significant 
knowledge-level increases. When the business game method was pitted 
against the case approach, and when case-based evaluation criteria were 
not employed, the [simulation] approach was superior to cases in 
producing knowledge gains.” 

b) David Pierfy (1977, pp. 255-268) reviewed 22 research reports that 
compared simulation-based treatments to conventional ones. Eleven of 
those studies assessed retention of knowledge by administering a post-test 
a second time, well after the training had been completed. Of these, 8 
studies found that retention was significantly better with simulation 
and gaming than with conventional lecture/study approaches. Further, 
8 of the 22 studies compared student interest in the subject matter, and 7 
out of those 8 found significantly higher interest reported by students 
participating in the simulation, than those in conventional training. 

c) Bredemeier and Greenblat (1981) synthesize the findings of Shade and 
Paine (1975), writing that they “...found more effective transfer of 
information through simulation than through conventional 
methods....” [author’s italics] They conclude “in sum, the available 
evidence suggests that simulation/games are at least as effective as other 
methods in facilitating subject matter learning and are more effective aids 
to retention...the available evidence thus suggests that, under certain 
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circumstances and for some students, simulation-gaming can be more 
effective than traditional methods of instruction in facilitating positive 
attitude change toward the subject and its purposes.” 

d) The Bredemeier and Greenblat (1981) finding is eehoed in Rosenfeld 
(1975), who writes that “although it is difficult to measure, there are 
many reports that simulation games significantly increase the 
motivation and interest level of student players.” 

These types of findings, as well as a realization that simulations have a potential 
in saving preeious resources, have led many organizations to make the move toward 
simulation-based training. 

In 1992, the Marine Corps began fielding the Indoor Simulated Marksmanship 
Trainer (ISMT) to train with a variety of weapons (i.e., M-249 Squad Automatic 
Weapons, M-9 pistols, shotguns, M-16 rifles and MP-5s) to improve proficiency. The 
ISMT provides a realistic environment to learn individual marksmanship skills. The 
trainer offers three types of shooting formats: (1) lane training, where Marines can hone 
their accuracy with the rifle and pistol from known distanees on both still and moving 
“B-Mod” targets, (2) eomputer-generated imagery and (3) video training. Detailed 
feedback, including visual shot grouping, accuracy ratings and pass/fail grading, provides 
the instructors and Marines the ehanee to identify their weaknesses and improve their 
marksmanship (Dobbs, 2008). 

Active duty Lieutenant Colonel William W. Yates (USMC) completed his Naval 
Postgraduate Sehool (NPS) thesis work in September 2004 involving the ISMT. In this 
work, he examined the effectiveness of the ISMT system as a tool to train shooters in the 
fundamentals of marksmanship. Key eoncepts explored in the researeh were a 
verifieation of skills transfer resulting from practice and the predictive value of simulated 
performance to profieiency at real task performance. The results of this work suggested 
that there was no statistical difference in the scores of recruits trained in the ISMT versus 
a eontrol group that was not trained in the ISMT. Seores on simulated firing were not a 
strong predictor of live fire performance. In a seeond experiment done for this thesis 
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work, the subjects were evaluated on their proficiency and improvement during un¬ 
coached practice at the task of simulated precision fire on a target at a simulated known 
distance of 300 yards from the shooters. After comparable amounts of practice in the 
ISMT, subjects who had not previously received formal marksmanship training failed to 
demonstrate levels of proficiency comparable to those subjects who had previously 
received formal marksmanship training in the military. Consequently, the research found 
no evidence to suggest the ISMT qualifies as a black box training apparatus capable of 
imparting skill through practice without the added presence of expert instruction or an 
existing knowledge of marksmanship techniques (Yates, 2004). 

Despite these less than stellar findings, the ISMT still serves as a viable augment 
for marksmanship training. For example, before live fire training on the range (i.e., 
during grass-week) Marines go to the ISMT and practice the fundamentals of 
marksmanship training alongside the assistance of a coach to monitor the Marine’s 
stances in the various firing positions. Also, while conducting live-fire training on the 
range during range-week. Marines supplement their live-fire training with additional time 
at the ISMT after range time to make adjustments to their firing stances as required, while 
emphasizing the fundamentals of marksmanship training. 

Dr. Anthony Ciavarelli (NFS faculty) continues to lead research projects 
involving the capabilities into the ISMT. The thesis work done by Army Major’s William 
L. Platte and Johnny J. Powers (2008) at NFS (both advised by Dr. Ciavarelli), sheds a 
more positive perspective on the use of the ISMT supported by motion capture 
technology to carry out marksmanship training: 

Virtual marksmanship trainers are currently used to provide the means to 
teach basic and advanced marksmanship skills, monitor performance 
progress from novice to expert, and maintain marksmanship skills. Our 
research was focused on the use of virtual marksmanship trainers to 
explore various training method enhancements based on recent studies of 
complex skill acquisition and expertise. The study of marksmanship skill 
and shooting characteristics benefited from the emergence of highly 
precise instrumentation for digital recording of the subject's performance. 

We used motion capture technology to define and to measure rifle 
shooting postural profiles associated with different levels of 
marksmanship expertise. Motion capture data revealed significant 
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(p<.008) differences between beginner and expert profdes. Using this 
knowledge to develop a training system for the standardization of expert 
level marksmanship performance would result in higher levels of expertise 
and the reduction of variance during the instruction of rifle marksmanship. 

In addition to the ISMT studies, Ibbitson’s (2005, p. 25) research has shown “that 
young people of today spend a lot of time outside of the classroom engaged with 
technology, including but not limited to television, movies, video console games, 
computer games, Internet surfing, instant messaging, e-mail, and downloading music.” 
The U.S. Marine Corps used the computer-based Marine DOOM to teach battlefield 
tactics outside of the field training environment in the mid-1990s (Rutherford, 2007). 
This is one of the earliest examples of modifying a desktop game for training purposes. In 
2002, the United States Army developed and released a series of video games and other 
media under the name of America’s Army as a global public relations initiative to help 
with recruitment. This has been the first computer video game to make recruitment an 
explicit goal and the first well-known overt use of computer gaming for political aims. 

America’s Army has also achieved a successful degree of imparting the training 
element to its soldiers and players. One player comments on how America’s Army helped 
him save people from a burning car (Wilson, 2008): 

I have received no prior medical training and can honestly say that 
because of the training and presentations within America's Army, I was 
able to help and possibly save the injured men. As I look back on the 
events of that day, the training that I received in the America's Army video 
game keeps coming to mind." I remember vividly in section four of the 
game's medic training, during the field medic scenarios, I had to evaluate 
the situation and place priority on the more critically wounded. In the case 
of this accident, I evaluated the situation and placed priority on the driver 
of the car who had missing fingers. I then recalled that in section two of 
the medic training, I learned about controlled bleeding. I noticed that the 
wounded man had severe bleeding that he could not control. I used a towel 
as a dressing and asked the man to hold the towel on his wound and to 
raise his hand above his head to lessen the blood flow which allowed me 
to evaluate his other injuries which included a cut on his head, (as cited by 
Wilson, 2008). 

In addition to the medic training, there is an extensive list of other military 

training ^ox America’s Army, and we name just a few here: 
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a) Javelin Missile System — Players train on a virtual Basic Skills Trainer 
(BST), which is based on the actual America's Army powered training 
simulator; a special "Live Fire" challenge is offered upon completion of 
the BST qualification. 

b) M1114 Up-Armored HMMWV with CROWS — A short, two-part, 
hands-on course including driving and gunnery qualifications. Players 
must complete both in order to operate the CROWS HMMWV in-game. 

c) Rifle Marksmanship (BRM) — M16A2 qualification has been enhanced 
to model the Army's new training curriculum and standards — earning 
Expert is a significant challenge. 

Master’s Thesis student David B. Nieborg, of Utrecht University, The 
Netherlands, completed his thesis work involving America’s Army in 2005. His work 
examined 

the status of the free state-of-the-art PC-game America’s Army within the 
military-entertainment complex and contemporary youth popular culture 
by exploring the implications of the interaction between commercial game 
culture, technology, marketing and military culture. Since the United 
States military uses the same simulation technologies as commercial game 
designers do, there is a blurring between commercial (military themed) 
games and governmental military simulations. The success oiAmerica’s 
Army has consequences for thinking about games and simulations and the 
use of these interactive texts strategically placed inside the synthetic 
environment for advertising, education, analysis and propaganda. The 
appropriation of a global game culture results in a dynamic relationship 
between the top-down institutional nature of the U.S. Military and the 
bottom-up participatory character of game communities and signals a shift 
of the changing status of the representation and simulation of war. (as 
cited by Nieborg, 2005). 

In their NPS thesis. Games for Training: Leveraging Commercial Off the Shelf 
Multi-player Gaming Software for Infantry Squad Collective Training, involving 
leveraging commercial off the shelf (COTS) games for use in military environments, 
Nolan and Jones (2005) conducted several training sessions. Initially they used the 
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lecture method and, to a lesser degree, hands-on computer control of their avatar (the 
virtual representation of a human within the game): 

We initially felt that the training we provided and their (the student’s) 
exposure to the game environment would be sufficient. Survey 
results...indicated that the participants felt that there was too much lecture 
and not enough hands-on training.. .Based on this feedback, we altered our 
training for the remaining two pilot studies. Our familiarization and 
training program evolved to a much shorter classroom presentation 
followed by a group, hands-on training session in the virtual 
environment....The positive results from these pilot studies led us to use 
this ads our training and familiarization technique during the experiment 
conducted at Ft Benning, GA. (as cited by Nolan & Jones, 2005, p. 25). 

Additionally, Nolan and Jones (2005) sought to find out whether the first person 
shooter games could effectively train squads in collective, leadership tasks, and decision 
making. They chose “combat drill” as the task that the experiment subjects would 
perform because it is a “collective action rapidly executed without applying a deliberate 
decision-making process” (as defined in FM 7-8, 2001, Chapter 4, p. 1—see Appendix 
A). They concluded the infantry squads can use COTS gaming software for this level and 
type of collective squad training. 

Previous research done in domain of training simulations suggested that a variety 
of methods have been used to teach participants to use simulation. However, the most 
effective one mentioned by these researchers is one where there is a short lecture phase 
preceding a “hands-on” training phase. This is where participants actually operate the 
simulation on their own. 

As of October 2007, Marines have been conducting infantry immersive training at 
the Infantry Immersion Trainer (IIT) aboard Camp Pendleton, CA, where the Office of 
Naval Research (ONR) has been a sponsor for several research teams and programs 
aimed towards refining the technologies found in the IIT training environment and 
studying the effectiveness of training in this facility. The work being conducted by the 
researchers at Pacific Science & Engineering collected extensive data sets and provided 
valuable information on infantry immersive training conducted in the IIT. The objective 
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of their research was to assess mixed reality, fully immersive infantry training and 
develop recommendations for enhanced technology to support training and performance 
assessment (Kobus & Palmer, 2009). 

The studies described in this section largely support the belief that simulation- 
based training is a viable and very valuable option for some forms of conventional 
training methods; in some cases training with simulations is the only training option 
available (example: training of emergency procedures in flight simulators). In cases 
where the simulation-based training does not provide an advantage over conventional 
training methods, it is encouraging to know its use can still generate positive effects 
(helps form mental maps and instigate motivation) while addressing targeted learning the 
training objectives. 

D. LEARNING AND TRAINING IN IMMERSIVE ENVIRONMENTS 

There is a realization in the training community about a gap that exists in the 
training of the Marine infantryman from classroom to the field. Simulation, particularly 
infantry immersive simulation, is considered as one type of tool that can fill that gap 
(U.S. Marine Corps, 2008). 

I. Training Needs and the Potential 

The casualty count from Iraq strongly suggests that infantry training should be 
strengthened by all means available to the USMC—this is a compelling requirement for 
the fleet (U.S. Marine Corps, 2008). This type of requirement is partly met by the 
creation of the Infantry Immersion Trainer (IIT) as a novel training facility that 
responded to the very needs identified in the training community. The chart presented in 
Figure 6 suggests that through September 2007, out of 998 Marine Corps deaths, 646 are 
from the Infantry Military Occupational Specialty (MOS) fields (Marine Times, 2007, 
October). 
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Figure 6. Iraq casualty chart (From Marine Times, 2007, October). 


Marine Corps researchers assess that the technology now supports the fidelity 
required to effectively train the infantry utilizing simulation (U.S. Marine Corps, 2008). 
By tapping into the existing training aids and simulation technologies to train Marines to 
operate and handle stressful, chaotic situations well before they reach the combat zone, 
the Marine Corps is increasing the chances those Marines will successfully get through 
their first combat experiences, whether an enemy attack, ambush or roadside bomb 
(Fuentes, 2007). 

Simulation training could carry over and have a profound effect on the battlefield. 
Successful simulation training could be the difference between life and death. The studies 
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have shown if one survives the first firefight, then the likelihood of that person surviving 
the rest of his or her tour is getting inereased (Puentes, 2007). A training experienee at the 
IIT eould be that first firefight. 

Depending on the goal, the potential for simulation-based training eould lead to 
any of the following advantages: 

a) Saving resources (human, material, logistic) —Savings already oeeur 
with flight simulators, where preeious resourees do get saved (i.e., human 
lives, fuel, parts, meehanies’ time, etc.). On VBS training. Marines can 
practice a good segment of convoy operations training without a need to 
go to a physical range and use real trucks (i.e., saving fuel, parts, logistics, 
etc.). 

b) Improving training skills that could not be trained otherwise —With 
the help of flight simulators, pilots are capable of training in a multitude of 
environments and scenarios. Pilots are able to practice emergency 
procedures, fly in rainy conditions over the skyline in South Korea, or 
even engage insurgents over Afghanistan. All those training situations 
would not be possible to recreate in regular (traditional) training setups. 

c) Training time made shorter —Flight simulators save time since there is 
no need to start the aircraft, warm it up or fly to the training area and there 
are no delays caused by actual clouds or bad weather conditions. Any 
topic or maneuver can be dealt with by freezing the simulator for 
discussion or evaluation purposes, and specific lessons can be practiced 
many times in a short period of time. 

d) Motivating trainees —According to Kobus and Palmer’s (2009) research 
conducted at the IIT, the Marines appeared to be motivated about the 
training environment. Positive feedback was observed with regard to (i) 
realism of sights, sounds, smells, (ii) complexity of environment, (iii) 
interaction with Arabic-speaking role players, and (iv) situation rapidly 
changing from calm to chaos. There is widely accepted understanding that 
a motivated learner (trainee) has a potential to be the best learner (trainee). 
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Yuhas et al. (2008) provided a list of convincing reasons for the need of continued 
immersion training for the infantry. Current and future conflicts require improved combat 
preparation skills for the infantryman. 

• Infantry home station training must provide for: 

- Inoculation of rifleman with the sights, sounds, smells, and chaos of 
battle. 

- Increased situational awareness for survivability and mission success. 

- Infantrymen are required to make immediate moral, ethical and legal 
decisions. 

• Small units should be trained as a “weapon system.” 

• Must conduct ground combat training for Irregular Warfare & Joint close 
combat among the innocent. 

• Need to provide training capabilities for small units that conduct ground 
combat in order to test our small units to high standards prior to entering 
combat. 

• Training must be tailorable, repeatable and affordably implemented. 


Greg Knapp (2008), Executive Director, Joint Warfighting Center (United States 
Joint Forces Command) states, ‘The first firefight should be no worse than the last 
simulation." 

By following the course of action already established by the IIT staff and 
incorporating the recommendations found in this thesis, it is our belief that the goals 
listed below by the IIT staff (Yuhas et al. 2008) can be achieved if units are provided 
with a well-structured exposure to multiple training situations in IIT. 

a) Increased efficacy of training 

b) Confident and effective combat decision making under complex 
conditions 
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c) Reduced friendly and innocent casualties 

d) Reduced collateral damage 

e) Soldiers and Marines better prepared for the chaos of the complex, 
distributed battlefield 

f) Increased mission success 

g) Increased combat effectiveness 

h) Reduced casualties, both friendly and civilian 

2. Current Approaches and Trends 

U.S. ground forces agree that adaptive, interactive, full immersion simulation can 
be an extremely effective way to expose Marines/soldiers to the rigors of ground combat 
(U.S. Marine Corps, 2008). Current Marine Corps practices in providing training with 
simulations can be described through reviewing the activity at the Marine Corps Air 
Ground Task Force Training Command (MAGTFTC) Battle Simulation Center (BSC) 
located in 29 Palms, CA (MAGTFTC BSC, Full-color Brochure, 2009); 

a) The BSC facilitates unit training with minimal overhead. By minimal 
overhead, we mean since the training is virtual, there is no extra 
expenditure of fuel, rations, ammunition or supply gear, nor does it require 
equipment maintenance or repairs for the training unit’s assets. 

b) Highly tailorable training. Since scenarios are very often hard to build 
(they require considerable technical expertise) the staff works with the unit 
and tailors existing scenarios or creates a training scenario specifically to 
meet the training unit’s needs. Training can be provided at several 
different levels, ranging from training for the individual Marine up to the 
regimental level. The BSC has a variety of simulation systems and models 
that it uses to enhance training. 

c) Flexibility. The lack of overhead required for simulation training allows 
for it to be conducted at almost any time of the day where the unit has a 
gap in their schedule. Virtually anyone can schedule BSC support very 

simply and usually on very short notice. 
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d) Persistence. The BSC is unaffected, by weather or other special events 
except in the most severe of cases. As such, it is always open for training 
when the training unit needs it. 

e) After Action Feedback. Near real-time feedback can be provided to 
analyze the unit’s performance. 

Tactical Training Exercise Control Group (TTECG) Coyotes have stated that they 
can tell which units have utilized the Simulation Center prior to going to the field because 
they are simply BETTER PREPARED (MAGTETC BSC, Eull-color Brochure, 2009). 
The Marine Corps also trains with simulations in the I MEE BSC aboard Camp 
Pendleton, CA in relatively the same way. However, the IIT is an additional facility only 
found at Camp Pendleton. 

a) The IIT staff also facilitates unit training with minimal overhead. By 

minimal overhead, we mean the IIT staff will provide the training unit 
with role players (both real and virtual), pyrotechnics technicians, training 
ammunition, and protective gear required for the indoor training. 

b) It offers highly tailorable training. Since scenarios are very often hard to 
build (they require considerable technical expertise) if the training unit 
plans ahead, the IIT staff will work with the training unit and tailor 
existing scenarios or create a training scenario specifically to meet the 
training unit’s needs. However, the IIT instructors do not receive formal 
training on how to use simulations effectively in training of the units. 
They must rely on their past experiences and established knowledge base 
to support the training effort. Because the IIT is a prototype, it does not 
include instructions on how to use it effectively in training (the instructors 
have technical manuals, but those do not provide information on 
simulation training.) Scenarios during the training can develop fast and 
change quickly. Eor the training to feel realistic, good intelligence 
procedures must be established and followed through. Understanding the 
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intelligence cycle and how it supports the planning process will only 
improve the unit’s situational awareness and overall combat effectiveness 
during the patrol. 

c) Flexibility. The lack of overhead required for simulation training allows it 
to be conducted by almost any size of unit. The idea behind the IIT was to 
be able to conduct squad (or even fire team) level training. However, the 
amount of friendly operational support required by a squad from a 
company-level intelligence cell (CLIC) and a company-level operations 
cell (CLOC) currently outweighs the possibility for this to occur in a 
traditional sense since that type of infrastructure and support structure 
does not exist. 

d) Persistence. The IIT is unaffected, by weather or other special events 
except in the most severe of cases. As such, it is always open for training 
when the training unit needs it. 

e) After Action Feedback. Near real-time video feedback can be provided 
to analyze the unit’s performance. However, this technology is not always 
capitalized on and units sometimes use no technology at all to support 
their learning process from the training conducted. Instead of capitalizing 
on the technology available to them, they will debrief in a dirt parking lot 
where many valuable lessons will be soon forgotten. 

E. CONCLUSION 

Military training that uses simulation technologies can come in many forms. The 
commonality for each of the different types of this training form, especially in 
environments that provide high levels of immersion, is that the users believe they are in a 
different environment than the real world. Through the extensive exposure to 
surroundings or conditions that are native or pertinent to the conditions and situations that 
the unit will be faced with in the operational theatre, the results and the effectiveness of 
that training can reach next (higher) level. 
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III. INFANTRY IMMERSION TRAINER (IIT) 


A. DESCRIPTION OF TRAINING ENVIRONMENT 

The military has been considered a community that by its definition needs to deal 
with and improve upon the technical tools and systems needed to conduct its basic 
missions—this is especially true in modern warfare and current missions that are 
associated with the military force. Innovation by the U.S. military has long been a proud 
tradition. However, with the fast pace of today’s technology, industry has begun to 
outpace the military’s once strength, and the military must find a way to continue 
innovating newer and better ways to train our military force with the technology available 
today. 

The Marine Corps has been willing to adopt new training opportunities offered 
through desktop simulations (i.e.. Marine DOOM, Close Combat Marines, VBS)—some 
of them became a part of standard training environment in some schools and simulation 
centers. With the improvement offered by today’s technology the service is willing to 
make a leap forward and include the immersive environments for the training of its 
infantry. For Marine Corps training, the creation of the IIT marked the start of a 
significant change from traditional field training techniques to computer supported 
immersive training. The IIT uses projectors that depict images on walls inside this 
training facility. These computer generated characters play a role of imagined civilian 
villagers or insurgent fighters (Rutherford, 2007). Physical artifacts, like furnishings, 
doors, and stairwells, add to the realism and can be rearranged to fit particular scenarios 
and alleviate the problem of going through the same scenario. This has been combined 
with other virtual effects such as explosions, loud sounds, smoke, and the smells of 
combat. The training plan for the IIT is to tie the trainer into a constructive game play 
that meets the unit’s training objectives for “particular missions, roles, and environments” 
(Fuentes, 2007). 
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This section provides a detailed description of the physical space and its layout, 
cultural artifacts that are situated inside the environment, role players and auditory and 
olfactory sensory stimuli used, as well as the training equipment used in each of the 
training scenarios. 

1. Location, Physical Space and the Layout 

The IIT training facility is approximately 32,000 square feet large, located in the 
Tomato Patch in the 62 Area of Camp Pendleton, CA. The training space (shown in 
Figure 7) is completely enclosed—it is an example of indoor training environment. The 
entire facility (except for the Admin and AAR/Debrief Room) is qualified as Special 
Effects Small Arms Marking System (SESAMS) capable; SESAMS are not utilized 
outside of the building. The environment is partitioned into the buildings, rooms, 
hallways, and larger public spaces such as souk (bazaar) and streets. Several of the 
internal buildings of the IIT have internal doors constructed of wood. These doors have 
been designed with kick panels requiring personnel to use force to kick them open. 
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Figure 7. IIT layout (From A1 Falljhradi.bmp) 


2. Cultural Artifacts 

A unique aspect of the IIT is its detailed incorporation of props and cultural 
artifacts. These items range from household items (i.e., carpets, cushions, dishes and 
pictures on the wall) to urban/village clutter such as bicycles and baskets as well as 
battlefield clutter (i.e., empty shells, wires, and ruins). All these items come together to 
generate a larger infrastructure that represent a typical urban environment (i.e., a village 
with houses, squares and a marketplace/bazaar). 
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Figures 8 and 9 show how furniture might be placed in a room at the IIT. This 
furniture then serves as a means to hide intelligence related documents and weapons 
which the Marines will search for during a cordon and search mission. To save cost, the 
majority of furniture at the IIT has been retrieved from the Defense Reutilization and 
Marketing Office (DRMO) at no cost to the Marine Corps (Alker, 2008). 




Figure 8. Typical room environment in IIT. 


Figure 9. A kitchen. 


Figures 10 through 15 illustrate the distinctiveness of the cultural artifacts found 
within the IIT, making the training so realistic to the Marines during their training. The 
infrastructure (i.e., hanging power lines and a market (souk)) found in a foreign country 
also adds to the immersive experience. There are even bicycles and a vehicle found 
within the facility to add the depth and realism to the role players’ activities. 



Figure 10. A room with a rug and pillows. Figure 11. Power lines run overhead. 
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Figure 12. Laundry hanging to dry. 


Figure 13. A bike and a shop in the Souk. 




Figure 14. A fruit stand in the Market (Souk). Figure 15. A view of the Market (Souk). 

3. Role Players 

Role players at the IIT eome in two basic forms—the form of live people and the 
avatars (virtual people): 

• Live people—these role players serve in a variety of positions to accommodate 
the training scenario. Elder, more experienced role players might be selected to 
serve in the position of a local Sheik during a “meet and greet” training situation 
(Figure 16), while others might serve as the local population (Figure 17). 
Additionally, Figure 18 depicts how select role players are contracted to act as 
“opposing force” (OPFOR) and have the required approval to engage in SESAMS 
training (Alker, 2008). 
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Figure 16. A meeting with the Sheik. Figure 17. Role players dressed in 

foreign clothes and acting as 
the local population. 



Figure 18. A role player serving as “opposing force” (OPFOR). 

• Avatars (virtual humans)—these role players create a safe and unique training 
opportunity for the Marines during room entry in so far as “Shoot” or “Don’t 
shoot” scenarios (Figure 19). Avatars are a great way to avoid putting live people 
in unnecessary harm’s way during training. The use of avatars in training could 
also help prevent needless deaths like the one that occurred October 30, 2006, 
aboard Camp Pendleton, CA when what was supposed to have been a non-live 
fire drill turned deadly (Marine Times, 2007b). 
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(a) Computer screen displaying avatars. (b) FlatWorld displaying avatar. 

Figure 19. Avatars used during “Shoot” or “Don’t Shoot” training upon room entry. 

Virtual avatars have an intrinsic value-added element for the training at the IIT. 
As pointed out by Dolezalek & Weinstein (2007), avatars allow users to hear and see the 
content in a compelling medium. They are not only interesting and visually stimulating; 
they also have the potential to drive home the training goals in a safe and effective 
manner if used successfully. Avatars are also appealing to the computer savvy age group 
who primarily fill the age group for today’s squad leaders. These individuals are 
accustomed to instant information access (via the Internet), and comfortable with 
technology. 

4. Auditory and Olfactory Sensory Stimuli 

High fidelity effects stimulate the Marines sights, smells, and hearing as the 
chaotic training scenarios are conducted. These “effects” are delivered in the form of 
Improvised Explosive Devices (lEDs) simulators (use of Soft Graphite/Air), Rocket 
Propelled Grenades (RPGs) being shot across the facility along well-concealed wires, 
speakers, and odor machines. The intent is to be able to incorporate Flashbangs, booby 
traps, blanks, SESAMS, non-lethal weapons (Alker, 2008), noise, and stench into an 
immersive battlefield. 

A specific auditory stimulus broadcast throughout the IIT is the Islamic call to 
prayer. Depending on the scenario, different messages can be broadcast from the mosque. 
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This additional noise factor adds to the experience of “being there,” whether the prayer is 
a slow peaceful one or a more violent and hostile one. The Marines will learn the 
difference so they can pick up on this particular atmospheric for their situation and when 
the situation gets intense, they will have seen the earlier indications. The rationale is that 
it is better to have first experience with this sensation during training rather then while 
overseas; if experienced for the first time during the deployment they can represent a 
source of chaos, confusion and sensory overload that may be very difficult to manage for 
the first time causing the Marines to become easy targets. 

Another sensation created within the IIT to support the experience of personal 
presence is the sense of smell (olfactory sensory stimulus). The smell of combat can 
come in many forms (i.e., burning trash, fuel, or rotting garbage). This sensation impacts 
some more than others and is another aspect of the IIT that makes the facility so valuable 
for training. 

5. Individual Equipment 

SESAMS provide realistic and safe training for Marines by using special rounds 
filled with color paste that leave a visible mark wherever it hits. SESAMS rounds can 
currently be fired with slightly modified M-16A2s or M9s (note the blue barrel on the 
Marine’s M16-A2 in Eigure 20). The barrel replacement process shown in Eigure 21 is 
required to accommodate the use of the M16-A2 with SESAMS rounds. During training. 
Marines have been known to get welts when a SESAMS round hits an unprotected area 
of the body (Eigure 22). Despite the bruise and stinging feeling from a welt, the Marines’ 
reaction to being hit by a SESAMS round is very positive due to the added sensation of 
realism. Eor safety concern, personal protective equipment (PPE) in the form of masks is 
worn by all personnel including the role players and instructors to protect the eyes and 
mouth. This unfortunately, is an aspect to the training that is not favored by the Marines’ 
because with the masks on their heads it becomes hard to interact and communicate with 
the role players and other Marines while trying to gather information of intelligence value 
and conduct their operations. 


42 




Figure 20. Blue barrels are used on the M16-A2 to fire SESAMS rounds and protective 

masks are worn to prevent injury. 



Figure 21. Barrel replacement with the M16-A2 is 
required to accommodate SESAMS 
rounds. 


Figure 22. A welt from a SESAMS 
round. 


B. CURRENT IIT CONDUCT OF TRAINING 

Marines are able to enter the IIT facility from up to four entry points and can 
conduct a range of urban warfare tasks from urban patrol, reaction to sniper fire, cordon 
and knock. Direct Action Raids, and satellite patrols (Alker, 2008). 

This section describes the training objectives of the IIT and some of the scenarios 
utilized to support those training objectives. We also cover and comment the limitation to 
the current training procedures. 
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1. 


Training Objectives and Scenarios 


Training goals for units consist of the following: 

a) Each Marine will learn to shoot, move and communicate in the 
urban environment. 

b) Each Marine will conduct urban patrolling. 

c) Each Marine will conduct room and building clearing. 

d) Each Marine will conduct immediate actions in response to threats 
in the urban environment. 

e) Each Marine will learn the basics of Middle Eastern operational 
culture. 

f) Each Marine will apply the basics of Middle Eastern operational 
culture in scripted tactical scenarios involving role players. 

During the combat, hostile incidents often seem to occur spontaneously, but there 
are usually indications that can alert Marines to imminent danger (MCWP 3-11.3). The 
most obvious are the sudden alteration of normal routines, patterns, and attitudes of the 
local populace or other unusual activity (MCWP 3-11.3). The IIT is an ideal location to 
train against some of the following situations, which are likely to be seen when operating 
in an urban environment (MCWP 3-11.3): 

• Enemy observers tracking the patrol. (Eor example, observers on rooftops, in 
windows, etc., who are obviously tracking the patrol.) 

• Pedestrian traffic. (Eor example, the unusual absence of pedestrian traffic and 
people on porches.) 

• Urban/village life. (Eor example, stores, markets or street vendors closed 
suddenly or without explanation.) 

• Civilian attitude towards the units. (Eor example, changes in civilian attitude 
toward patrol members.) 
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• Foreigners in the area. (For example, unknown individuals or vehicles in the 
patrol area.) 

• Things out of the ordinary. (For example, unfamiliar vehicles parked in the patrol 
area [possible car bomb]). 

• Unusual activity by locals. (For example, children throwing rocks at patrols to 
possibly draw the patrol’s attention away from a more serious danger, such as a 
deliberate ambush.) 

• Hostile activity by locals. (For example, agitators trying to provoke an incident 
with patrol members.) 

• Change in local atmospherics. (For example, anti-American graffiti suddenly 
appearing in the patrol area.) 

• Appearance of propaganda. (For example, pictures of enemy leaders and martyrs 
posted in the patrol area.) 

2. Limitation of Current Training Procedures 

The limited space within the IIT facility is a clear drawback. According to MEF 
Standard Operating Procedures (SOP), the minimum stand off distance for an lED is 300 
meters. The IIT does not allow this to properly occur and could potentially create poor 
training habits. A quick solution to this problem would be to identify the current lEDs 
used in the scenarios as pipe bombs. The long-term solution is to create a facility large 
enough to support this amount of stand off distance. 

Another limitation from our observations was the hesitation to react to the virtual 
characters (i.e., avatars) displayed on the walls. Marines paid more attention to the real 
role players and this caused the Marines to miss things that they were supposed to react to 
in the shoot/don’t shoot scenarios. Indecision to the virtual characters often led to 
mistakes being made because of the uncertainty to engage the hostile virtual targets. 
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C. PAST AND CURRENT RESEARCH STUDIES 

The Office of Naval Research (ONR) has been a sponsor for several research 
teams and programs aimed towards refining the technologies found in IIT training 
environment and studying the effectiveness of training in this facility. The work being 
conducted by the researchers at Pacific Science & Engineering collected extensive data 
sets and provided valuable information on infantry immersive training conducted in the 
IIT. The objective of their research was to assess mixed reality, fully immersive infantry 
training and develop recommendations for enhanced technology to support training and 
performance assessment (Kobus & Palmer, 2009). The hypothesis they stated was, 
“Incorporation of performance metrics and supporting capabilities such as After Action 
Review (AAR) will improve mixed reality based infantry training.” To achieve this 
objective, they have developed the following technical approach: 

• Identify capabilities of IIT for meeting specific infantry training objectives. 

• Develop performance metrics for training and retention of skills supported by IIT. 

• Provide recommendations for technology such as after action review (AAR) to 
support mixed reality immersive infantry training and performance assessment. 

Some additional reporting on the IIT is summarized here: 

I. Palmer, Kobus, & Kobus (2008a & 2008b) interviewed and provided 
written questionnaires to 15 Marines who visited the IIT shortly after 
returning from deployment to Iraq and also a group of 105 Marines with 
0-2 deployments to the Middle East. Erom this research, they were able to 
ascertain some positive feedback regarding training at the IIT involving 
the realism of the sights, sounds and smells within the facility. The 
complexity of the training environment, with the situation rapidly 
changing from calm to chaos, along with the ability to interact with 
Arabic-speaking role players were viewed very positively. The primary 
criticisms were related to the confined space of the facility. 
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2. Dister & Kobus (2009) conducted research to assess traeking teehnology 
with respect to improving situation awareness in the eontrol room and of 
the trainers throughout faeility. They are eontinuing their work with a goal 
of providing added value to the AAR proeess and for the perceived 
potential eontributions to performanee assessment. 

3. During their Skill Retention Study, Palmer, Kobus, & Kobus (2009) 
observed several researeh challenges due to the IIT being a training 
facility where operational eommitments take priority. For example, the 
research effort was planned for two days to compare skill retention. Day 1 
involved 40 partieipants, while due to operational tempo; Day 2 involved 
only 16 of the original 40 Marines. This eaused a problem for maintaining 
squad integrity. Lessons Learned ineluded the following: 

a) As long as IIT operates as range (vs. trainer), scientifie and 
systematie assessment will be limited. 

b) IIT is underutilized as “train as you fight” opportunity for 
eommunieations training whieh is eritieal for eombat effeetiveness 
and valuable for assessing situational awareness (in squads and as 
eonveyed to higher eommand). 

e) Potential value (for both training and assessment) as an AAR tool. 

D. FUTURE PLANS FOR IIT 

Similar to the pilots need for flight simulators, the infantry need to expand 
infantry immersive training and make faeilities available on other USMC bases. At 
present time, a second IIT facility is planned for the new Marine Expeditionary Rifle 
Integration Faeility in Quantieo, Virginia. The IIT will ineorporate the results of several 
ONR-sponsored researeh efforts, as well as teehnologies sponsored by the U.S. Army 
Researeh Development and Engineering Command and the University of Southern 
California’s Institute for Creative Technologies. Additionally, several members of the 
faeulty for the Modeling Virtual Environments and Simulations (MOVES) Institute at the 
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Naval Postgraduate School (NPS) in Monterey, California are collaborating with the 
University of North Carolina (UNC) at Chapel Hill through Behavioral Analysis and 
Synthesis for Intelligent Training project sponsored by the ONR to develop a 
visualization that can be presented on a Virtual Sand Table developed by UNC team 
(Figure 23) that could potentially support infantry immersion training for the Marine 
Corps. 



Figure 23. Positioning the physical artifacts Figure 24. Virtual Sand Table using the 
on the Virtual Sand Table. Magic Marker capability. 

The Virtual Sand Table is a unique combination of traditional media (three- 
dimensional physical artifacts) and a contemporary form of data presentation (digital 
simulation). The domain for this platform is urban warfare operations; however, the same 
platform and the same concepts can be deployed in a variety of other domains. The 
primary objective of the Virtual Sand Table is to enable a military team discussion during 
their mission rehearsal, and present the environment and terrain data, as well as dynamic 
data sets that illustrate unit's movement on the terrain. A Magic Marker capability (Figure 
24) has also been added to allow for sketching unit's planned movement and to mark the 
potential danger zones identified in the environment. ONR’s investment in this Virtual 
Sand Table technology research could benefit the IIT and similar training environments 
(as cited in Sadagic, 2009). 

To support the idea for robotic-based cultural awareness training at the IIT, work 
done by Dragone et al. (date unknown) goes on to explain that with the development of 
the field of social robot research in recent years, a strong need has developed for a 
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coherent development framework for heterogeneous robots that supports explieit soeial 
interaetion between robots (whether real or virtual) and between robots and humans. In 
situating this work in the eurrent state of the art in the field, it is important to highlight 
that there are generally two eamps of soeial robot researeh aimed at developing 
deliberative pro-aetive soeial eapabilities. 

The first involves the development of explieit eontrol arehiteetures for (ideally) 
heterogeneous robots with the eapaeity to eommunieate, eoordinate, and engage in soeial 
eomplex inter-robot behaviors. The soeial interaetion design strategy is primarily based 
on a bottom-up approaeh where the soeial eapabilities are often additional 
eommunioation meehanisms implemented on robotie deviees. There are numerous 
“levels” of sophistioation from simple message passing through, for example, light-based 
transmitters and reeeivers (Grey, 1967) and more reeently (Billard & Dautenhahn, 1997), 
to more sophistieated Belief-Desire-Intention-based soeial eontrol paradigms as found in 
the Soeial Robot Arehiteeture (Duffy, 2000 & 2004). 

The seeond approaeh to soeial robot researeh involves empowering a robot with 
the soeial funetionality required to engage human partieipants in some form of direeted 
soeial engagement. Sueh systems often involve building robotie deviees with a degree of 
anthropomorphie representation (head, body, faeial expressions, hand gestures, ete.) (see 
Duffy, 2003 for a diseussion). The eontrol systems generally employ key human-eentrie 
interaetion modalities sueh as speeeh and even models of emotion in order to realize as 
natural a soeial interaetion as possible. Continued researeh in the field of roboties and 
avatar support is highly eneouraged to sustain the training at the IIT and to mitigate the 
requirement for eostly role players. 

The Marine Corps is taking a eritieal step towards ehanging the way infantry 
training is eondueted. Marines will be able to walk or run through these simulated spaees 
in their eombat gear with their personal weapon—this has been a priority for General 
Mattis. Future growth ean be expeeted as the Marine Corps shifts its foeus from one 
theater to another (i.e., Iraq to Afghanistan). One possible loeation for a future IIT to 
support mountain warfare training, following an Afghan-seenario would be at Marine 

Corps Mountain Warfare Training Center (MCMWTC) in Bridgeport, California. 
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IV. INTELLIGENCE CYCLE ACTIONS TO SUPPORT, “EVERY 
MARINE IS A COLLECTOR, AND EVERY MARINE IS A 

REPORTER” 

A. COUNTER INSURGENCY (COIN) AND THE NEED FOR HUMAN 
INTELLIGENCE (HUMINT) IN AN URBAN ENVIRONMENT 

The purpose of the realistie training at the IIT is to enforce the harsh physical 
realities of a combat environment. In conjunction with this learning objective, the 
Marines have the opportunity to also realize the importance they all play in the 
intelligence cycle. By having a good intelligence picture, the Marines can generate tempo 
and stay one step ahead of enemy activity. The lesson for each Marine, “Every Marine is 
a Collector, and Every Marine is a Reporter” supports this effort. Despite the shock and 
commotion occurring around them, they need to be able to remain focused to more 
effectively observe enemy activities and react in such a manner that gives them the 
initiative and supports accomplishing the mission. The intelligence cycle represents a tool 
for improving situational awareness and gaining the initiative. The intelligence cycle 
consists of six continuous phases integrated together in an ordered and structured way. 
Eigure 25 illustrates the six phases of the intelligence cycle. 
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Planning & Direction 


Utilization 



Dissemination 


Cd lection 



Processing & E)^Dloitdion 



Figure 25. Six phases of the Intelligenee Cyele. 

1. Planning and Direction 

The intelligenee eyele begins with planning and direction. This phase eonsists of 
the identifieation of intelligenee requirements and the planning of intelligenee operations 
and aetivities to satisfy those requirements. The eommander direets priorities for the 
intelligenee effort. Those intelligenee requirements for whieh a eommander has an 
antieipated and stated priority in his task of planning and deeision making beeome 
priority intelligenee requirements (PIRs) (Marine Corps Doetrinal Publieation (MCDP) 
2 ). 

During this phase Marines will analyze their Higher Headquarters (HHQ) 
operations order and will likely brief eaeh other from either a sand table or terrain model 
(Figure 26). 
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Figure 26. A terrain model used for training. 


2. Collection 

Collection is the second phase of the intelligence cycle. Marines training in the 
IIT have the opportunity to be evaluated on their ability to accurately collect information 
during their training evolution. They will learn what information to disregard and what 
information to share immediately (MCDP 2). Combat information is defined as the 
"unevaluated" data, gathered by or provided directly to the commander which, due to its 
perishable nature or criticality of the situation, cannot be processed into tactical 
intelligence in time to satisfy the user's tactical intelligence requirements. It is the 
information that must be acted upon immediately in order to get any benefit out of it. 

Actions taken during this step might be searching a person or a room. The tools 
used by the Marines during this step might include their tactical notebook or a camera 
during tactical site exploitation. This is the step where each Marine enforces the saying of 
“Every Marine is a Collector.” 

3. Processing and Exploitation 

Processing and exploitation is the third phase of the intelligence cycle. This is 
largely a technical function done by the Battalion S-2 section and would not involve the 
infantry squads training at the IIT. However, it would be beneficial for these infantry 
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Marines to understand that processing and exploitation converts the data into an 
understandable form and enhances its presentation (MCDP 2). 

4. Production 

The fourth phase of the intelligence cycle is production, the activities by which 
processed data is converted into intelligence products (MCDP 2). This is a step primarily 
conducted through the efforts of the intelligence section. These products (Figure 27) 
could resemble a Fligh Value Individual (HVI) list or Modified Combined Obstacle 
Overlay (MCOO). 


Urban Modified Combined 
Obstacle Overlay (MCOO) 

Figure 27. Intelligence products to be used by Marines. 

5. Dissemination 

The fifth phase of the intelligence cycle is dissemination, the timely conveyance 
of intelligence in an appropriate form and by a suitable means to those who need it 
(Figure 28). Depending on its importance and time-sensitivity, intelligence may be 
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disseminated— “pushed” —direetly to users or it ean be sent to an aceessible data base 
from whieh eommanders ean “pull” that intelligenee whieh they need (MCDP 2). 

It is during this phase of the intelligence cycle where Marines implement the 
saying, “Every Marine is a Reporter.” 



Ta cti ca I rad i os P encil sk etch Si notes 

for Intel reporting 

Figure 28. Intelligence tools for Dissemination. 


6. Utilization 

The final phase in the intelligence cycle is utilization (Figure 29). The commander 
may provide direction, information may be collected and converted into intelligence, and 
the intelligence may be disseminated, but unless that intelligence is exploited through 
decision and action, it has served no purpose. Utilization is not a function of intelligence 
per se, but rather of command and control—making the decision and then carrying it out. 
This reinforces two important points: first, intelligence has no value for its own sake but 
assumes value only when acted upon; and secondly, intelligence is inextricably linked to 
command and control. No one phase of the intelligence cycle is more important than the 
others—they are interdependent (MCDP 2). 
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Figure 29. The final step of the intelligenee eyele—^Utilization. 

B. INTEGRATION OF FULL INTELLIGENCE CYCLE IN TRAINING 

Although mueh effort has been dedicated on technology to support the training at 
the IIT, there is still much work to be done with the fundamentals at the Squad, and Fire 
Team levels. In a real combat environment, intelligence drives operations; however, this 
“train as you fight” concept has not reached fruition in the current setup at the IIT; 
intelligence is minimally factored into the training. This, we believe, could and should be 
appropriately addressed. Following review of the identified segments of training that 
could be improved, we will present training recommendations that can fully integrate all 
phases of the intelligence cycle and will better prepare the Marines for mission 
accomplishment in a combat environment. 

The most distinctive portion of this thesis is the unprecedented practice of 
completely integrating the intelligence cycle into the infantry simulation training within 
the virtual environment of the IIT and instilling the concept of “Every Marine is a 
Collector, and Every Marine is a Reporter.” Without question, the IIT could become the 
classroom of the future for the ground-pounding leathernecks to experience combat as 
close to reality while at the same time learning how to remain focused when surrounded 
by the chaos of battle. Today’s young Marines thrive for new technology and the 
intensity of the training at the IIT fully grasps their undivided attention and fits distinctly 
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with their learning style. The IIT is designed to replicate the chaos and confusion of 
close-quarter battle as well as the situations that incorporate tactical cultural awareness 
and address ethical issues that Marines may encounter in an urban conflict. 

The primary purpose of this thesis is to validate the need for an emphasis on the 
integration of the intelligence cycle supported by advanced technological solutions to 
more successfully train and measure the usefulness of their training at the Infantry 
Immersive Trainer located at Camp Pendleton, CA. In order to fully support this 
objective, our thesis will provide a plan for a location and configuration of a Squad 
Planning Operations Center (SPOC) within the IIT for Intelligence Briefs and After 
Action Reviews (AAR)/Debriefs. 
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V. CASE STUDY OF COC OPERATIONS 


A. GHANA: AFRICAN CONTINGENCY OPERATIONS TRAINING AND 
ASSISTANCE (ACOTA) MISSION 

This chapter relates to a case study eondueted by the author to examine a foreign 
military’s Combat Operations Center (COC) functionality and how that experience was 
used to gain a fresh perspective on sueh operations. 

This seetion provides a description of the training event, its timeline, and relevant 
after aetion comments. We comment the lessons learned and provide the 
recommendations that were transferred to our main study. 

I. ACOTA—Ghana CPX (15-26 September 08): General Information 

• Mission: The purpose of the exercise was to prepare a Ghanaian battalion 
eommander and his battalion staff for deployment on a United Nations Mission in 
Congo (MONUC). 

• Who, When & Where; 

- Ghanaian Armed Forees (GAF), composite Battalion (Bn) 

- Burma Camp, Accra 

• The author was one of four U.S. Marine offieers assigned to 
support this training mission. 

• Training: The training consisted of one week of a Command Post Exereise 
followed by one week of a computer-assisted exereise (CAX) [utilizing Joint 
Army Navy Uniform Simulation (JANUS)]. JANUS is an interactive, digital 
simulation of combined-arms warfare named after the Roman god, “Janus,” who 
guarded Rome’s city gates (Massachusetts National Guard, 2009). 
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Schedule: 


During Week 1, the Marine mentors engaged their staff counterparts (Figure 30) 
during the practical exercise of the orders development process; the examples of how the 
mentors have tackled problems and planning considerations were also provided. 

- Week 1; 

• Day 1; Introduction/Issue of Bde order (Mission Analysis and back 
brief) 

• Day 2:COA Development (COA Brief) 

• Day 3: COA Wargame (COA Decision) 

• Day 4: Orders Development 

• Day 5; Bn Orders Briefs (Rehearsal of Computer Assisted 
Exercise, for Bn staff and exercise Controllers) 



During Week 2, the Marine mentors combined a mixture of filing the billet of a 
Higher HQ staff Officer and their staff counterparts, ensuring that any personal 
experiences or planning considerations observed are accounted for. 
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Week 2; 


• Day 6-10: Computer-assisted exereise, to inelude the use of role 
players. The battalion was provided with the seenarios that tested 
the Battalion order. The seenarios involved all warfighting 
funetions. The seenarios beeame progressively more ehallenging 
and they were developed from a UN Chapter VI to Chapter Vll 
seenario. 

• Marine mentors also eonsidered the issues sueh as information flow within a staff 

seetion as well as with other elements of the staff. COC setup also played a role in 

assisting the Bn to internet. 

After Action Comments : 

a) Topic: Situational Awareness 

Discussion: During week 1, the Bn praetieed the Military Deeision Making 
Proeess (MDMP) and reeeived periods of instruetion on the proeess by the instruetor 
eadre. Student briefs were organized, well delivered and supported by visual produets. 
Week 2 saw a shift to some old habits, (i.e., getting away from the map to brief off and a 
laek of visual produets to support the presentations, eausing situational awareness to be 
hampered to a degree). 

Recommendation: Continue to refine and update produets. Just beeause one 
makes a produet onee does not mean it is eompleted. One must get the feedbaek and find 
new information, then develop new produets to give improved Situational Awareness. 

b) Topic: Operational Rhythm 

Discussion: The author of this thesis provided a period of instruetion on the topie 
of “Operational Rhythm” during week 1. The ACOTA prepared slides were very useful 
and well organized, allowing the instruetor to step in and deliver a quality presentation. 
This presentation pointed out the good work that was eompleted during week 1 by the 
Battalion staff, and introdueed how the prepared products could now be summarized and 
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re-created to have even more training value during week 2 when the pace of activity 
would be increasing. The S-2 received the input very well and was able to generate useful 
products to support his staff level function. 

Recommendation: To improve Operational Rhythm, consolidate and summarize 
known information to allow an individual to better analyze and assess new information as 
it comes in. Prioritize all requirements, and then act in a manner to quickly satisfy them. 
Doing so will give an advantage over the adversary. 

c) Topic: Follow-through 

Discussion: When the battalion assigned tasks to companies, they did not have a 
process for following through to ensure that tasks were actually completed. Likewise, 
when companies requested support from the battalion (and support was approved), they 
did not have a process to ensure that the action was ever completed. These failures to 
close the loop often created confusion when tasks were not accomplished because the 
companies and/or battalion assumed that the tasks had already been completed. 

Recommendation: Ensure a solid process is in place to follow up on assigned 
tasks. Establish estimated times for tasks to be completed, and if status of the task has not 
been given to you after the estimated time has passed, ask for it. This will ensure a push- 
pull system to follow up on all assigned tasks. 

B. USMC COC OPERATIONS 

Infantry squads are most likely to communicate directly with either a company or 
battalion level COC. The COC is the cornerstone for the Marine Air-Ground Task Eorce 
Command and Control (MAGTE-C2) concept. Within MAGTE-C2 concept, information 
is integrated, aggregated and distributed from disparate Marine and Joint C2 and ISR 
systems to users at all echelons—from the command center to the individual Marine 
(General Dynamics, 2007). 

The following lessons learned from this case study supported our research goals 
for finding a way to improve IIT training through integrating intelligence activities: 
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1. Infantry simulation training must find a way to integrate situational 
awareness aetivities by ereating a ehanging environment where 
information is eollected, then analyzed for intelligenee value and refined 
into updated intelligence products that are then disseminated for the next 
training scenario. 

2. Infantry simulation training must find a way to test a unit’s Operational 
Rhythm and create a stressful environment were units must prioritize 
requirements, and then act in a manner to quickly satisfy them. 

3. Infantry simulation training should create a chaotic atmosphere that 
challenges a unit’s ability to clearly communicate task completion. 

Our main study COC would need to replicate the planning, collection efforts, 
dissemination, and utilization of intelligence and employment of communication 
procedures expected to be executed by the infantry squads during combat. 
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VI. PILOT STUDY 


A. INTRODUCTION 

This study sought to explore whether the integration of an Augmented Combat 
Operations Center (A-COC) to the IIT would improve current training practices. Despite 
the substantial effort dedicated to the technology used to support this training, much work 
remains to be done with the fundamentals at the squad and fire team levels. In an actual 
combat environment, intelligence drives operations; however, this “train as you fight” 
concept has not yet reached fruition in the current setup at the IIT; intelligence is 
minimally factored into the training. It is our intention to introduce a framework within 
which it will be possible to support and have a process that supports the integration of the 
full intelligence cycle. 

B. RESEARCH HYPOTHESIS, EXPERIMENTAL SETUP AND METHOD 

I. Research Hypothesis 

Training at the IIT, even though highly advanced during the actual training run, 
makes no use of information technology during its briefings. Most pre- and post training 
briefings are conducted in a yard outside the IIT. Even though teams arrive as a pre¬ 
trained unit at the IIT, it is hypothesized that improvement in the team briefing processes 
may be possible to achieve. Information technology equipment in an A-COC was used to 
enhance the briefing experience as well as the team’s interaction prior to and after 
conducting a patrol. The theory was that teams would get a better understanding of their 
individual objective and experience higher team cohesion. It was also hypothesized that 
they will experience different team interaction dynamics, resulting in a higher 
performance than without the use of an A-COC. 

We established the following hypothesis: 

HO (Null hypothesis): There is no difference between the teams being briefed in 

the atrium of Watkins Hall and those using the A-COC. 
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HA (Alternative hypothesis): Teams receiving augmented pre- and post-action 
briefings within an A-COC will experience different team interaction dynamics resulting 
in higher performance than those not using an A-COC. 

2. Experimental Setup and Procedure 

a. Participant Selection and Team Interactions 

A convenience sample of twenty-three U.S. Marines from Defense 
Language Institute (DLI), Monterey, CA (21 male and 2 female) participated in this pilot 
study. The mean time in service for the participants was nine months; they all had non¬ 
infantry Military Occupation Skill designators; and the mean age was 19 years old. 
Participants were randomly formed into six fire teams of four participants each (except 
for one fire team that had three participants.) 

Fire teams were randomly assigned to form a control group (replicating 
current IIT briefing procedures) and an experimental group (utilizing the A-COC.) 

Possible participants were either NPS or DLI military volunteers. As 
participants at the IIT are rather young and inexperienced, NPS population was discarded 
as a possible participant pool, and the very much younger and inexperienced DLI pool 
chosen instead, as they are thought to be a better represent those at the IIT. Nonetheless, 
these participants are not good representations of IIT participants and therefore any 
results of this study are not transferable to the IIT. 

Participants not assigned to teams were used as role-players. Besides them 
not wearing civilian attire, these role-players added additional variance by not being 
trained for what they depicted. Additionally there were two groups of role-players for the 
morning and afternoon iterations, adding an additional amount of variance to their 
depictions. Role-players tend to immerse and identify with their role, adding new 
elements to their performance on each iteration. To control for these undesirable 
developments, their actions should be scripted so they do not vary their performance 
based on whom they encounter or how much experience and inherent improvisation 
talent they have. We attempted to establish certain level of control by providing the same 
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briefing to the role players; however, it was very diffieult to retain full eontrol onee the 
patrol (experiment) started. Role-players are not aetors but seripted eneounters, espeeially 
within an experiment. 


As predieted, small groups will form quite fast, espeeially sinee they 
eomposed of military personnel who are trained to form teams fast. It might be that the 
groups that formed the fastest aetually ran into team storming issues by the third 
experiment. This would explain why some teams (espeeially 3 and 5) were aetually 
getting worse in both their eombined proeess and performanee seore. On the other hand, 
it might also be possible that those teams never really ended their forming phase and had 
serious internal struggles resulting in degrading internal team proeesses over time. 
Finally, the different performanees by the partieipants may also be due to chance, as this 
experiment only generated six data points to measure. Even though it is not possible to 
determine the cause now, the evaluation sheet should be adjusted to incorporate any 
observations that might explain these varying performances. 

It might also have been interesting to record the sex of the participants, as 
there were both homogeneous and heterogeneous teams tested. Even though this data 
might not be of interest at first glance, some interactions might still be explained by the 
team’s composition. 

b. Method 

This study was conducted over a period of 12 hours. The control group 
arrived in the morning and the experimental group arrived in the afternoon. Both groups 
followed the same schedule of events, beginning with refresher training on patrolling and 
intelligence activities (Eigure 31). The participants then received the scenario brief and 
update briefs with the aid of different media to see if the difference in media presentation 
impacted training. All six fire teams completed three urban patrols. The participants 
completed self-report questionnaires and where under direct observation by an observer 
who also completed an evaluation form on team performance. 


67 




Figure 31. Participants receiving periods of instruction. 

Consent forms (included in Appendix B) were distributed the day prior to 
the senior Marine who would be present. It was arranged to have the control group arrive 
in the morning and the experimental group to arrive in the afternoon. Neither group knew 
what the other group was doing, only that there would be two groups of participants. The 
IRB paperwork is included in Appendix C. 

All participants completed the survey included in Appendix D. The same 
questionnaire was used after each scenario (the sections to be filled in Patrols 2 and 3 
were omitted as they were identical). Evaluators completed the form included in 
Appendix E. The same form was used after each scenario (therefore, the portions to be 
filled in following Patrols 2 and 3 were omitted from this thesis). 

The timeline of events (included in Appendix E) began in the same 
manner for each group; 

a. Collect informed consent forms. 

b. Deliver two periods of instruction on patrolling and intelligence 
activities for the group (classroom lecture). 

The participants “Higher Headquarters (HHQ)” provided the following 
information during the scenario and update briefs (MCWP 3-11.3); 

a. Designated the area for patrol. 

b. Intelligence briefs and updates. 
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c. Special equipment required for the mission (camera and 
communications equipment.) was replicated with cell phones in place 
of actual military equipment. 

d. Urban maps, photos, as required. 

e. Prescribed rules of engagement (ROE). 

The control group was taken out of the classroom setting and into a lobby 
area where the Operations/Intelligence brief was read to them (Figure 32). The scenarios 
are included in Appendix G. The teams then began to plan and rehearse for their assigned 
patrol mission. Each subsequent update brief and debrief took place in the same lobby 
area without the other teams listening in. 



Figure 32. Participants receiving their briefing in the foyer. 

For the experimental group, the participants were presented the identical 
scenario in the same classroom used for instruction, which now served as the A-COC 
(Figure 33). This group received a PowerPoint presentation of the Operations/Intelligence 
brief and had a high-resolution image of the first patrol route available to them for 
planning and After Action Review (AAR). Teams in this group were also afforded space 
on the walls to hang up intelligence products that they created based on the information 
gained during the conduct of their patrols. 
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Figure 33. Participants conducting planning in the A-COC. 

The scenario that has been utilized in IIT training was modified to meet 
the needs of this pilot study. The tasks for each of the three scenarios remained similarly 
intact to satisfy problem solving by requiring the participants to plan, re-plan, and engage 
in multifaceted decision-making within the situations presented during their patrols where 
information was at times unclear. This study’s scenarios were based on two separate 
briefing processes, where the participants were tasked with gathering information on the 
local atmospherics of their area of operation and the level of enemy activity in that area 
while under time constraints, to facilitate peace in their assigned area of operation. The 
solutions were complex; they included; 

a. Gathering physical intelligence on enemy activity. 

b. Gathering HUMINT on enemy activities, as well as local leadership 
attitudes and atmospherics towards our friendly forces through an 
interview with the local Chief. 

To see the type of tasks to be completed in more detail, please observe the 
script layout for Patrol 2, which is illustrated in Figure 34. 
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Morth 


Watkins Hall P* Floor (2d Patrol) 

Bldg 246 



Patrol needs to UP DAT EM API 


Figure 34. An example of a seript layout for the evaluator; listing the tasks to be 

eompleted by the fire teams. 

The experiment was executed around and inside the first and second floors 
of Watkins Hall of the Naval Postgraduate School (NPS), Monterey, CA. The control 
group received all their situation updates and debriefings inside the main foyer of 
Watkins Hall. The experimental group was briefed inside a classroom (i.e., the A-COC) 
fitted with selected Information Technology (IT) infrastructure, allowing the teams to 
further plan and talk through their next patrol, as well as debrief their patrols. 

The first experiment was set up to introduce all possible encounter types 
that would be seen during experiments two and three. It was set up outside Watkins Hall. 
Participants were training their basic patrolling skills and interaction with non-hostile 
civilians. The patrolling route at first is wide open, but later forces the teams to group 
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more densely, as is required inside the buildings. Participants learn to accept the 
evaluator is present, taking notes and acting as the remote command radio operator on the 
fire team’s replicated reports and situation updates [through the use of cell phones verse 
actual military equipment]. 

During the second experiment, participants are to patrol a long narrow 
corridor depicted by the downstairs corridors of Watkins Hall, at the end entering the 
second foyer. Participants are forced to interact with local population that is not speaking 
good English. Participants are expected to search for and recover information of 
intelligence value (Figure 35), update area maps that are inaccurate, and find and report a 
weapons cache. 



Figure 35. Participants collecting items of intelligence value. 


In the final experiment, interaction and reporting are most assessed. After 
patrolling through confining spaces and interacting with a civilian using a walkie-talkie, 
the team leader has to make a choice as to go left or right into a mostly identical corridor. 
When turning right, the team discovers a room full of weapons and enemy intelligence, 
and then a local chief and his armed guards (Figure 36). If turning left, first the chief and 
then the weapons, possibly hinted at by the chief, are encountered. 
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Figure 36. Participants’ arriving at the local chiefs residence. 


Weapons handled by the participants are fully functional softair M4 and 
Colt 1911 replicas. Weapons and lEDs hidden on the three patrol courses are blue and red 
colored dummy rubber weapon. These dummies are the correct size and weight as a real 
weapon but have no functional components. 

Post-task (post-patrol) survey measures contained multiple items focused 
on understanding the mission, teamwork, and task outcome, recorded on six-point and 
seven-point Likert scales, as well as short answer responses and basic demographic items. 

Before and after each patrol the participants and evaluators were afforded 
time to fill out their survey questionnaires. Patrols lasted anywhere from 20-30 minutes 
and at the 30-minute mark were required to ENDEX due to time constraints. The 
participants were dismissed after they completed the third post-patrol survey. 


C. RESULTS 


This section elaborates the results collected by the evaluators; where applicable 
we describe and visualize them graphically. The evaluations of the third patrol conducted 
by the team three were not recorded (the evaluator forgot to fill in the evaluation sheet). 
The data was then analyzed and is described statistically. Due to the missing data, any 
tests on the control group as well as inter-group comparisons have less statistical 
significance. Eigure 37 describes the individual team scores of experiment one through 
three from 1 (low) through 6 (high). Data for cohesion and team-play are inverted. Notice 
the missing data on team 3, Experiment 3. 
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Figure 37. Individual team scores for experiments 1 through 3. 


1. Team Performance by Task 

Team-performance and team-cohesion levels varied strongly. Overall the grades 
given by the evaluators are skewed towards higher scores, only one evaluator plotted 
scores of 2 and below, even though the teams training level was very basic. 

Observed team motivation did not change during the three experiments for any 
team. Team performance and team processes all increased over the three experiments, 
even if this were not always reflected in the teams overall score. Overall, improvements 
are higher from the first to the second than in between the second and third experiment. 
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The individual result tree (Figure 38) is generated by determining the median of 
the team processes and the normalized team performance data. The median is used as the 
data is ordinal in nature.^ The data seems to be skewed towards top scores. Also 
interesting is that team performance and team processes appear not to be interdependent. 

One of the questions asked whether an informal leader emerged other than the 
dedicated team leader. This is observed in 4 out of the 18 trials. 

Team Result Measurements 

Experiments. 1 through 3 

Team Performance-1 

Team processes • 1 

Team Perfo rtrance - 2 

Team processes • 2 

Team Performance-3 

Team processes-3 

0 I 2 3 4 s 6 

Figure 38. Team performance vs. Team processes in Experiments 1 through 3. 

2. Analysis 

A mistake noted during data analysis was that all questions should have been in 
the form of seven-point Likert scale questions vice six-point. The error was corrected for 
this analysis by converting the seven-point Likert scale to be able to construct a common 
measure. This was one of many learning points discovered during the conduct of the pilot 
study. A great deal of time was later devoted to the creation of the survey questionnaires 
for the main study conducted at the IIT. It was identified that the questionnaires should 
include predominately seven-point Likert scale questions to better assist during the data 
analysis process. 

1 Please see the conclusion at the end of this chapter for further explanation. 
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Additionally, the evaluator forms needed to be improved to support more 
“Yes/No” questions, as well as adding extra spaee to support journal entries to remind the 
evaluator of the five Ws (Who, What, Where, When, Why?) to assist during the AAR. 
Good examples of Yes/No questions (to later be used in the main study) include the 
following (MCWP 3-11.3): 

• Did the Patrol Leader use proper formations for the movement? 

• If contact was made with the enemy, did the Patrol Leader take 
appropriate action? 

It was also decided that based on participant military experiences, the main 
research survey would conclude by asking questions involving thoughts on the Ill’s 
overall training effectiveness. The questions would be in the following format using a 
seven-point Likert scale: 

• The IIT was an effective way to train me how to patrol in an urban 
environment. 

• The IIT was an effective way to train me how to patrol in an urban 
environment versus other urban environment training that I have done in 
the past. 

• Having experienced actual urban environment patrolling, the IIT was an 
effective way to train me how to patrol in an urban environment. 

To conduct independent variable t-tests comparing the control and experimental 
groups the following questions were planned to be asked of the participants (again, using 
the seven-point Likert scale): 

• This IIT training improved my urban patrolling skills. 

• This IIT training improved my information gathering skills. 

With this knowledge gained, we continued forward on our analysis of the data. 
Using a histogram and overlaying a normal distribution (Figure 39), it is visibly 
determined that the team performance and team process scores are not normally 
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distributed (a = 4.75; SD = 1.17). Therefore any statistical analysis of the data is 
performed using nonparametric tests. This reduces the power of those tests significantly, 
especially as the number of measures is small to begin with. 

Distributions 


Resuit Patrol 1 



- Normal(4.75824.1.17004) 

Fitted Normal 

Figure 39. Distribution of ratings shows no correspondence to normal. 

A dilemma is encountered as the data for this analysis is collected by Likert and 
ipsative scales. Even though in psychological and human factors research Likert scales 
are accepted to contain interval data, this is not the case with ipsative scales. This results 
in a test on ordinal and not interval data, and reduces the power of any statistical test. 

For all tests an a—score of significance at the 0.05 level is chosen. 

Within Experiments Comparison 

The first evaluation on the data is a test to determine if there is significant 
difference between the six teams within the three experiments. A Wilcox Signed Rank 
Test of nonparametric data is used on the data. Figures 40-42 show the boxplots for the 
data collected. 

For Patrol 1, fire teams 4 and 6 were the only teams who performed completely 
below the mean, making the control group the better performers overall for Patrol 1. The 
analysis for Patrol 1 is summarized in Figure 40. 
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Figure 40. Comparison of each fire team’s overall performance during the 1st Patrol. 

For Patrol 2, we see fire team 4 again performing completely below the mean. On 
this occasion, they were the only team to do so, although fire teams 3 and 6 were not 
much better. However, for a second time we see fire team 6 performing poorly when 
compared to the remaining fire teams. The control group and the experimental group 
were similar in nature, but again we see the control group being the better performer. The 
analysis for Patrol 2 is summarized in Figure 41. 

For Patrol 3, we are missing the evaluator data for fire team 3 because the 
evaluator failed to fill in that information and this error was not identified until the data 
analysis phase of the pilot study. This is yet again another lesson in supervision of the 
experimental process. When collecting forms, they need to be thoroughly inspected 
before letting the individual turning it in depart the area. 
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Figure 41. Comparison of each fire team’s overall performance during the 2nd Patrol. 

As for the data analysis of Patrol 3, we again we see a poor performance by fire 
team 4. Additionally, fire team 4 and fire team 5 were the only teams to completely fall 
below the mean. Of note is the marked improvement by fire team 6. Even without the 
data for fire team 3, we see for a third time the control group performed better. The 
analysis for Patrol 3 is summarized in Figure 42. 



Figure 42. Comparison of each fire team’s overall performance during the 3rd Patrol. 

Data calculations for within experiments analysis of patrols 1 through 3 spanning 
all groups is explained further here. The results for all tests show no significant 

differences between the six teams. The probability to observe the studies results is 
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between 12% and 25%. The results for experiment 1 are: prob > = 0.23, for experiment 

2: prob > = 0.25, and for experiment 3: prob > = 0.12. The same test is used to 

determine differenees between eaeh team in each group within each experiment. This 
also results in no statistical significant differences (p = 0.187). To allow for these tests, 
the observed performance scores for each experiment where summed and then compared. 

Additionally, the sample sizes are rather small and therefore not very convincing. 
It is also a threat to validity of these tests. Observe the missing data in Figure 39 for team 
3 within the control group. This test was done on summed data, such as not to compare 
dependent data on a y^ test. 

Within Groups Comparison 

Even though the six teams are not significantly different within each test, this 
does not mean there is no difference between the control and experimental groups 
overall. To test for this a contingency analysis of the groups is performed and a 2 statistic 
for difference computed. The resulting y^ statistic shows that the two groups have no 
statistically significant differences with t = 0.248 (Figure 43). 
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Oneway Analysis of Total Score By Group 

17 - 

16- 


B 14- 
I- 

13 - 

12 - 

^ ^ control experimenl 

Grcup 

Wilcoxon / Kruskal-Wallis Tests (Rank Sums) 

(Mean- 

Level Count Score Sum Score Mean MeanOi StcIO 

control 2 8.000 4.00000 0.866 

experiment 3 7.000 2.33333 -0.866 

2-Sample Test, Normal Approximation 
S Z Prob>|Z| 

8 0.86603 0.3865 

1-way Test, ChiSquare Approximation 
ChiSquare DF Piob>ChiSq 

1.3333 1 0.2482 


Figure 43. test for difference returns no significant result for differences between the 

two groups. 


statistics using a nonparametric test on interval data was employed as a 
comparison using Pearson’s p is not permissible due to the data being not normal, ordinal 
and dependent at least within teams. Figure 44 illustrates the overall test for difference 
between the control group and experiment group. This test, contrary to the ordinal nature 
of the collected data, assumes interval-type scales and normal data. It was performed to 
show how the use of ordinal data scales influenced the results, as with this statistic there 
is a significant difference in between the two groups with p(l) = 0.035. This test is not 
allowed as a) the data is not normal b) the data is ordinal c) there is interdependence in 
the data used for this test. Each team gains experience in each experiment and this is 
influencing the second and third experiment’s score. Therefore, the data is dependent, 
test assume independence of the data. Additionally, each experiment generates two scores 
for each experiment, a process score and a performance score. These two scores are also 
interdependent. 
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Figure 44. Overall test for difference between the control and experimental groups. 


A mean score for each group within each experiment was computed. The results 
of each team were then summed. The resulting number is assumed to be on a quasi¬ 
interval scale, thus being permissible for a 'f statistic. Summing the data will also prevent 
any influence of the Yule-Simpson effect (Simpson, 1951). 

The emergence of an informal leader is speculated to have an effect on the teams 
overall performance. According to Bacal (2008), informal leadership in a small group 
may either have a positive or negative influence on performance based on the actions of 
the dedicated team leader. In this study, the emergence of an informal leader is not shown 
to have statistically significant effects. Neither a low performance nor low team process 
score nor a high performance and high team process score is associated with the 
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emergence of an informal leader. Performance and cumulative team process score are not 
correlated. A team can exhibit a high performance score and have a low cumulative 
process score. Predictions of a team’s performance on the basis of team processes overall 
explains only 22% of variance. 

The experiment results are expected to be encountered about 17 out of 100 times. 
The null Hypothesis of no significant differences by the use of an A-COC is therefore 
retained. 

Figure 45 compares the mean results of the control versus the experiment group. 
Data is normalized from 0 through 6. The control group has a mean rating result of 5.18, 
while the experimental group has a mean rating result of 4.35. The differences in the 
result are not statistically significant. 

Control vs. Experimental Group 

6 

5 

4 

3 

2 

1 

0 

control experimwital 

Figure 45. Mean results of the control versus the experimental group. 

It must be noted that team three’s result vector was omitted from the control 
group’s results, as replacing missing data with the mean of either the whole experiment 
or the control group mean seemed to be changing the overall result. 
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D. DISCUSSION 


The objectives of this experiment were to see if the introduction of intelligence 
activities improved performance, while at the same time forcing the individual team 
members to work together. The three experiments were designed to show how each team 
is forming and how the team is growing into a cooperating unit. 

Choosing Marines that are not part of any specific combat group, are 
comparatively young and inexperienced in the task at hand is thought to have a higher 
probability to show any statistically significant effects of an A-COC. 

An important objective for the experiment was also to collect information and 
discover any fallacies and shortcomings of the setup for further research. The most 
significant aspect of these observations is the improved setup of the evaluators form, and 
fine-tuning of the questions given to the evaluators. 

The primary purpose of this pilot study was to validate the need for an emphasis 
on the integration of the intelligence cycle supported by advanced technological solutions 
to more successfully train and measure the usefulness of their training at the IIT. The 
conduct of this pilot study has provided a great deal of information to improve upon to 
achieve this objective. To begin with, the recommendation to configure an A-COC within 
100 meters from the IIT for the Marine’s to receive and conduct their 
Operations/Intelligence Briefs and After Action Reviews (AARsj/Debriefs (Figure 46) is 
going to be modified to instead recommend the creation of a Squad Planning Operations 
Center (SPOC) at roughly the same distance to more satisfactorily meet the needs and 
requirements for an infantry squad versus a battalion staff. 
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Figure 46. Participants conducting an After Action Review and Debrief. 

Squads do not require a tremendous amount of technical data to prepare for their 
patrols. Instead, they need easy access to a sand table or terrain model to talk through 
their plan. This is not to say that technology cannot support the squad, because it can. It 
just needs to be user-friendly and easily digestible in a short period of time because the 
squads would rather spend their rehearsal and planning time talking and walking through 
their standard operating procedures (SOPs) because the level of uncertainty is so high for 
them that they must prepare for a multiple of contingencies that they might face while on 
patrol. Pictures and other images that the squad can take with them are useful since they 
can put this material in their pockets to review as time allows. They are also able to 
compare pictures that they may have on them to people that they may meet while on 
patrol, rather than trying to recall from memory. In urban environments, these factors 
significantly increase and quickly become a challenge if not managed correctly. 

An item of interest regarding the A-COC was that we had an inappropriate 
number of people manning it. The fire teams were too busy preparing for their patrol that 
they could not access the technology available to them; instead it just became a 
distraction to their planning. This is one conclusion as to why the experimental group did 
not outperform the control group. The participants were easily overwhelmed and only 
one individual had ever even been in an actual Battalion COC, so the technology was not 
conducive to their planning activities. 
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Ideally, it would be best to have personnel available to answer any requests for 
information (RFIs) as they arise so that the squad ean continue planning at their level and 
then have the questions answered at a later time before departing for the patrol. This 
allows for multiple tasks to be accomplished at once. Many Battalion Intelligence 
Officer’s (S-2’s) utilize this technique in Marine Expeditionary Unit (MEU) Special 
Operations Capable (SOC) units, were the S-2 staff, normally consisting of about five 
Marines must divide and conquer to satisfy the battalion’s multiple REIs to support 
overlapping missions. 

This information process, utilizing the SPOC, would significantly help to reduce 
uncertainty for the patrol, while simultaneously generating tempo. 

One question that must be addressed is will this new SPOC concept at the IIT lead 
to an overall training effectiveness and performance improvement? The proper method 
for evaluating this data will be to collect subjective evaluations coupled with data 
collected from objective evaluations that will provide the most accurate view of the IIT’s 
effectiveness. The answer to these questions might get us one step closer to improving 
immersion training for the infantry squads. 

1. Limitations and Challenges 

Eimitations to this study include: 

a) Eire teams being put together on the spot rather than from already 
cohesive units. 

b) Using fire teams vice squads; this factor required the fire team to 
address task requirements that have could have been more widely 
distributed among a squad (i.e.. Enemy Prisoner of War 
(EPW)/Detainee team, AID/Eitter team. Tactical Site Exploitation 
(TSE) team). 

c) Youth and inexperience on behalf of the participants. This became 
an issue with over-aggressiveness on behalf of the participants who 
tended to take a hard approach toward the local Chief who could 
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have provided them with a vast amount of intelligenee. However, 
we did see two fire teams 1 and 6 perform very soundly during this 
aetivity. 

d) Time was short for the fire teams. They were foreed to eome 
together as a team very rapidly. Making mistakes was only natural 
for them as they began to develop as a team and understand eaeh 
other’s style. 

e) The difficult task of trying to replicate a $1.3 million facility and 
its manning made this a challenging task, but overall, the intentions 
for this pilot study appear to have been satisfied and we can now 
begin the planning for our onsite research where many of these 
problems will be resolved just by being on the actual site of the 
IIT. 

a. Evaluator Variability 

Each team was evaluated by a dedicated, overt observer during all 
experiments. Video cameras were not used during the experiment. The final briefing and 
after action reviews were captured by video camera for later evaluation. As the observer 
follows the team during all three experiments, it is possible to observe improvements 
(Sur, 2004). During all experiments teams were scored on two overall scores, ten 
teamwork related scores and, for the last two experiments, three improvement related 
scores. Overall scores are Likert scales, whereas the team scores are ipsative or forced 
choice scales. There are also free form questions, but those are not evaluated for this 
thesis. 

The independent variable is the use of an A-COC or not. The A-COC is a 

classroom fitted with multiple laptop computers, an overhead projector and a 26” 

widescreen monitor. It is important to note that the information given to each team does 

not differ in content, only in form of delivery (verbal vs. screen, paper vs. projector). 

Teams are not forced to use the A-COC for planning purposes, but were sent into the A- 

COC for each debrief. It is hypothesized that teams get a better understanding of their 
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team members as well as their objectives. Thus, the team forms faster as they can use the 
time in the A-COC for understanding each other in a collaborative environment. They are 
also hypothesized to outperform the control group as they act as a team and can therefore 
interact faster and better than the teams in the control group. 

In order to measure team processes, evaluators observe the team’s 
processes and the team performance. A team’s performance is objectively rated in 
relation to objectives briefed prior to each patrol. Team processes are collected 
subjectively on 12 scales. Three questions collect the role of the team leader, three 
questions the teams communication, three questions the team-play and one each the 
teams cohesion, motivation and the occurrence of an informal leader. On the second and 
third experiment, measures of improvement in communication, teamwork and overall 
performance are also collected. Measures are recorded on multiple ipsative, a bivariate 
and a Likert scale. 

Due to the date and length of the experiment, it was hard to recruit 
evaluators. Five evaluators were used for six teams. All evaluators were field officers 
with recent field experience. The evaluators were not trained on the use and meaning of 
the questionnaire, and therefore interpreted each question from their own point of view. 
This resulted in them sometimes contradicting the actual meaning of a question as it was 
intended to be asked. This insight was gained due to annotations next to the rating scales, 
which were not requested, but helpful to understand the results. Additionally, no 
measures of inter-rater reliability were devised. This meant that the observer’s scores are 
actually not comparable, as each evaluator might devise his own baseline. The observer’s 
baseline was instantiated on the first experiment, which was rated, by design, as an easy 
one. Once the observers rated the participants high in this round, they had difficulty 
rating them worse on following, harder experiments. 

A different problem was experienced by an evaluator not finishing the 
evaluation. This results in an additional measure of variance and further reduces the 
validity of the data analysis. 
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Evaluators should, at best, be involved in working out the questionnaire. 
At the very least, the evaluators need to have a elear understanding of the meaning of 
eaeh question, and to be tested for inter-rater reliability. This ean be aeeomplished by 
showing a video of a patrols performance, and the evaluators independently rating this 
video. Or, they could be read a patrolling story, after which they individually rate the 
performance of the patrol. Using this as a template, the scores of all evaluators can be 
adjusted for equal variance, making the results truly comparable. 

b. General Evaluation Setup 

Participants also provided data on their experience using a questionnaire. 
They filled out these questionnaires before and after each experiment iteration. 
Participant’s responses were free form and Likert scale responses. The participant’s free 
form responses are not evaluated for this thesis. 

Some of the problems with analysis validity are also inherent in the setup 
of the experiment and the evaluation sheet. The first problem in the execution of the 
study was time allotted per team and experiment. During the experiment, time granted for 
the teams to practice and rehearse as well as time to execute each patrol varied 
significantly. While some teams had more than half an hour to prepare and another half 
hour to execute their patrol, some other teams prepared and executed their patrol within 
half of that time. As the teams were just forming, these differences in training and 
execution time may have had some significant interactions within team processes 
measured. 

Besides training time, the number of teams and experiments conducted 
was just too low. With three teams on three experiments each, in between two to eight 
degrees of freedom are possible. These are low degrees of freedom for any statistical test. 
Therefore, any statistics will show a high variance, and have low power. A higher 
number of both participants, as well as experimental conditions are desirable. The groups 
should each perform in at least seven experimental conditions, and there should be at 
least eight teams for each independent variable tested. For the IIT experiment, as the 
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teams should have formed during the training leading up to the IIT, a within subjeets 
design, eontrolled for order effeets, might be desirable. 

Finally, the design of the evaluation sheets and questionnaires was done 
without having any later evaluation in mind. The design was done on grounds of the 
research question only, and even that process was hastened. Usually, after the research 
question is stated, a hypothesis is developed. On basis of that hypothesis, statistical tests 
are evaluated and chosen. The requirements of each test are duly noted. After this is 
finished, questions allowing for the statistical procedure chosen are developed, as 
explained earlier. Using this approach, a good statistical test may be employed to get 
answers from the data collected. 

2. Conclusion 

This study observed and collected data on formative team processes in the course 
of a pilot study testing the design of a planned experiment at the IIT aboard Camp 
Pendleton, CA. It was hypothesized that participants of the group using the A-COC 
would benefit from this experience. It was thought that they would experience better team 
processes resulting in a better performance than the control group. The control group was 
not using an A-COC for pre- and post briefings. 

Contrary to the hypothesis, the null hypothesis of no difference in between the 
two groups was retained. This unexpected result is probably due to several causes. First, 
there were deficiencies in the planning, setup and execution of the study. Secondly, the 
participants of the study had not enough experience in conducting the range of tasks they 
were asked to perform in the study. Third, the data collection was unsatisfactory, both by 
design and by the untrained observer’s variability. Finally, due to all the precious 
shortcomings, the statistical tests allowed were weak and could not refuse the null 
Hypothesis. This does not imply that the A-COC does not have any effect. At this time, it 
demonstrates that the setup did not allow any possible effects to have any statistical 
significance. 
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The pilot study did have a significant effect insofar as it explicitly shows areas in 
need of improvement for a future study. As this is the main task of a pilot study, and any 
true results are but a bonus, we consider this study a huge success. 

Following review of the pilot study data, we were able to plan accordingly for our 
main research collection effort. 
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VII. INTEGRATION OF THE INTELLIGENCE CYCLE AT THE 

HT: MAIN STUDY 


A. INTRODUCTION 

This main objective of this thesis is to explore whether the integration of a full 
intelligence cycle to the IIT would result in better unit performances and improve current 
training practices in this training facility. Despite the tremendous effort already dedicated 
to the technology used to support the training at the IIT, much work remains to be done 
with the fundamentals at the squad and fire team levels. In an actual combat environment, 
intelligence drives operations; however, this “train as you fight” concept has not yet 
reached fruition in the current setup at the IIT; intelligence is minimally factored into the 
training. 

The main study was conducted over a two-week period. The control group 
participated during the first week utilizing current IIT training procedures and the 
treatment group participated during the second week utilizing a Squad Planning 
Operations Center (SPOC) for planning purposes. Both groups followed the same 
schedule of events, beginning with training on intelligence activities. The participants 
then received the scenario brief and update briefs from their unit’s leadership. All 
participants completed anywhere from three to five patrols through the IIT. The 
participants completed self-report questionnaires and where under direct observation by 
observers who also completed an evaluation form on the squad’s performance. 

B. FUNCTIONAL ANALYSIS 

Based on our observations of the current approaches and trends at the IIT, we 
have completed a functional analysis for training in this immersive environment. 

Assumptions: 

The following assumptions regarding the structure of the team and the training 
situation have been established and accepted for all scenarios conducted in IIT: 
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i. Patrol leader is a Junior Offieer or Non-Commissioned Officer (NCO). 

ii. Assistant patrol leader is a Staff NCO or NCO. 
ill. Medical support is available. 

iv. This is a combat patrol. 

Initial State: Receive Patrol Mission 

We list our overall training goals here: 

1.0 GOAL: Patrol Planning (Patrol Leader/Assistant Patrol Leader). 

Individual tasks required to satisfactorily complete the goal of patrol 
planning: 

1.1 OPERATOR: Go to Squad Planning Operations Center 
(SPOC) to receive Mission Brief (cognitive). 

1.2 OPERATOR: Report to company-level intelligence cell 
(CEIC) to receive intelligence brief/report (cognitive). 

1.3 OPERATOR: Ensure adequate security/logistic support for 
patrol/mission (cognitive/perceptual). 

1.4 OPERATOR: Ensure adequate medical support for 
patrol/mission (cognitive/perceptual). 

1.5 OPERATOR: Ensure adequate combat engineer/breeching 
support for the patrol/mission if necessary (cognitive/perceptual). 

1.6 OPERATOR: Ensure operational check of all communications 
equipment is accomplished (cognitive/perceptual/motor). 

1.7 OPERATOR: Establish and maintain kill sheet 
(cognitive/perceptual). 

1.8 OPERATOR: Ensure all equipment and vehicles accounted for 
(cognitive/perceptual). 
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1.9 OPERATOR; First echelon maintenance check on all 
vehicles/fuel levels if necessary (cognitive/perceptual/motor). 

1.10 OPERATOR: Ensure extra fuel containers/water containers 
are full (cognitive/perceptual/motor). 

1.11 OPERATOR: Ensure logistics requirements met for patrol— 
food, water, gear (cognitive/perceptual/motor). 

1.12 OPERATOR; Brief drivers/assistant drivers: Patrol Brief 
(cognitive/perceptual). 

1.13 OPERATOR: Final Brief to Watch Officer in SPOC 
(cognitive/perceptual). 

1.13.1- turn in final manifest of gear and personnel 
(cognitive/perceptual). 

1.13.2- ensure adequate copies of kill sheet 

(cognitive/perceptual). 

1.13.3- final communications check 

(cognitive/perceptual/motor). 

Learning Outcomes 

Examples of Learning Cognitive Objectives: 

a) The student will receive the Mission Brief and understand its 
intent. 

b) The student will be able to receive the Intelligence Brief/Report 
and discern what is pertinent to his mission. 

Example of Perceptual Motor Learning Objective: 

a) The student will ensure operational checks of all communications 
equipment. 

2.0 GOAF: Immediate Actions on Patrol 

Individual tasks required to satisfactorily complete the goal for immediate 
actions on patrol under the following circumstances: 


95 



2.1 GOAL: Ambush 


2.1.1 OPERATOR: MenA^ehicles in the kill zone 
immediately get out of the kill zone (eognitive/perceptual/motor). 

2.1.2 OPERATOR: MenA^ehicles not in the kill zone 
immediately seek cover and lay down suppressive fire in the 
direction of the ambush (eognitive/perceptual/motor). 

2.1.3 OPERATOR: Assault through the enemy 
(eognitive/perceptual/motor). 

2.1.4 OPERATOR: Consolidate, Communicate, Patrol 
Eeader makes the call whether to abort or complete mission 
(cognitive/perceptual). 

2.2 GOAE: Improvised Explosive Device 

2.2.1 OPERATOR: Men/Vehicles in the kill zone 
immediately get out of the kill zone. It could be an ambush 
(eognitive/perceptual/motor). 

2.2.2 OPERATOR: Men/Vehicles not in the kill zone 
immediately seek cover and prepare to lay down suppressive fire 
(eognitive/perceptual/motor). 

2.2.3 OPERATOR: MEDEVAC procedures, follow-on, 
possible communication to call in for close air support, request 
MEDEVAC, etc. (cognitive/perceptuaEmotor). 

2.2.4 OPERATOR: Consolidate, Communicate, Patrol 
Eeader makes the call whether to abort or complete the mission 
(cognitive/perceptual). 

2.3 GOAL: Obstacle or Chokepoint ahead 

2.3.1 OPERATOR: Send some of security attachment 
ahead to investigate (eognitive/perceptual/motor). 
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2.3.2 OPERATOR: If necessary, send Breeching Team to 
breech possible obstacles, explode necessary devices, open up 
chokepoint if possible (cognitive/perceptual/motor). 

2.3.3 OPERATOR: Seek cover if stopped; prepare to lay 
down suppressive fire (cognitive/perceptual/motor). 

Learning Outcomes 

Examples of Learning Cognitive Objectives: 

a) If ambushed, the student will be able to assault through the enemy. 
Example of Perceptual Motor Learning Objective: 

a) If ambushed, the student will ensure all Men/Vehicles not in the 
kill zone immediately seek cover and lay down suppressive fire in 
the direction of the ambush. 

b) If faced with an obstacle, and if necessary, the student will send the 
Breeching Team to breech possible obstacles, explode necessary 
devices, and open up chokepoint. 

Example of an Attitude/Affective Objective: 

a) The student will engage in successful interaction with other patrol 
members through effectively sharing information and relaying 
necessary communications up and down the chain of command. 

b) The student will show courtesy to foreign citizens (role players). 

c) The patrol leader will trust senior leadership to provide additional 
fire support if required. 

3.0 GOAL: Mission Complete, Post-Patrol Brief 

Individual tasks required to satisfactorily complete the goal for mission 
completion and post-patrol brief: 

3.1 OPERATOR: Patrol Leader Report Immediately to SPOC your 
destination to give intelligence brief/report of situation on the ground 
(cognitive/perceptual). 

3.2 OPERATOR: Patrol Leader Report to SPOC with Kill Sheet 
Information—people and accountability (cognitive/perceptual). 
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3.3 OPERATOR: While supplies are being delivered, Patrol 
Leader and Assistant Patrol Leader de-brief with Patrol members, 
Medieal, Communieations for lessons learned (eognitive/pereeptual). 

Learning Outcomes 

Examples of Learning Cognitive Objectives: 

a) hollowing the patrol, the student will be able to immediately report 
to the CLIC and give their intelligenee debrief/report. 

Example of an Attitude/Affective Objective: 

a) The student will engage in sueeessful interaetion with other patrol 
members through effeetively eondueting a patrol debrief and AAR. 

C. RESEARCH HYPOTHESIS, EXPERIMENTAL SETUP AND METHOD 

I. Research Hypothesis 

Training at the IIT, even though highly advaneed during the aetual training run, 
makes no use of information teehnology during its briefings. Most pre- and post-training 
briefings are eondueted in a yard outside the IIT. Even though teams arrive as a pre¬ 
trained unit at the IIT, it is hypothesized that improvement in the team briefing proeesses 
may be possible to aehieve. Information teehnology equipment in an SPOC was used to 
enhanee the briefing experienee as well as the team’s interaetion prior to and after 
eondueting a patrol. The theory was that teams would get a better understanding of their 
individual objeetive and experienee a higher interaetion. They will experienee different 
team proeesses, resulting in a higher performanee than without the use of a SPOC. 

HO (Null hypothesis): There is no differenee in squad performanee and team 
interaetion between the squads reeeiving very short briefings in the yard outside the IIT 
and those being briefed using the speeially designated SPOC. 

HA (Alternative hypothesis): Teams reeeiving the well struetured pre- and post¬ 
action briefings within the SPOC will experience different team processes resulting in 
higher performance and display higher team interaction than those who receive very short 
briefings outside the IIT. 
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2. 


Participant Selection and Team Interactions 


A convenience sample of 153 U.S. Marines from Camp Pendleton, CA 
participated in this study. The mean time in service for the participants in the control 
group was 6 years and 6 months, while the mean time in service for the participants in the 
treatment group was 2 years and 8 months. The control group consisted primarily of non¬ 
infantry Military Occupation Skill (MOS) designators, while the treatment group 
consisted primarily of Marines with an infantry MOS. The mean age for the 60 
participants in the control group was 25 years and 9 months, while the mean age of the 
participants in the treatment group was 21 years and 7 14 months. Participants were 
already formed into squads by their parent command. 

3. Experimental Setup and Procedure 

Consent forms (included in Appendix H) were distributed and signed upon arrival 
to the training site. The IRB paperwork is included in Appendix I. All participants 
completed the survey included in Appendix J. The same questionnaire was used after 
each scenario - to avoid unnecessary duplication we include only a copy of questionnaire 
for Patrol 1. The survey ended with a set of concluding questions that were answered 
after the final patrol. 

Evaluators and the units platoon leadership completed the evaluation form 
included in Appendix K. The same form was used after each scenario; as for the subjects’ 
questionnaires we include only a copy for Patrol 1. 

a. General Evaluation Setup 

Participants provided data on their experience using a questionnaire. They 
filled out these questionnaires prior to and after each experiment iteration. Participant’s 
responses were free form and Likert scale responses. The participant’s free form 
responses are not evaluated statistically for this thesis. During each patrol, the squads 
were self evaluated on seven basic knowledge scores, two mission understanding related 
scores, eight self assessment scores, seven CGA interaction scores and, for the last 
experiment, five improvement related scores. 
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b. Timeline and Scenarios 

The timeline of events has been designed and was eompleted in the same 
manner for both eontrol group and treatment groups (Appendix L). Once the informed 
consent forms were collected, participants were given a period of instruction on 
intelligence activities. The participants “Higher Headquarters (HHQ)” provided the 
following information during the scenario and subsequent update briefs (MCWP 3-11.3); 

• Designated area for patrol. 

• Intelligence briefs and updates. 

• Instructions on how to use of special equipment required for the mission 
(note: actual camera use and communications equipment was replaced 
with the use of cell phones.) 

• Urban maps, photos, as required. 

• Rules of engagement (ROE). 

It is important to note that while the training scenarios were not identical, 
they were very much of the same level of complexity to avoid any information from 
being compromised and tainting the data collected. The control group was taken out of 
the administrative setting and into the west parking lot area to establish a staging area 
where the Operations/Intelligence brief was read to them. The teams then began to plan 
and rehearse for their assigned patrol mission. Each subsequent update brief and debrief 
took place in the same parking lot area (Eigure 47). 


1 

J 

Eigure 47. Control group participants conducting a debrief following a patrol. 
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For the treatment group, the partieipants were presented with similar urban 
patrol type seenarios but instead of staging in the parking lot, operated out of the SPOC. 
This group reeeived a brief from the platoon commander over a terrain model built out of 
MRE boxes (Figure 48) by the first squad of the treatment group to conduct training 
through the IIT. Of interest, the unit was not giving guidance on how to conduct mission 
planning, only that the SPOC was open to utilize as they saw fit for their planning 
purposes. This briefing style was done on the accord of the unit’s leadership, and not by 
our design. In essence, through the use of the terrain model, the unit created a simple 
motion capture village that they could plan from. 

Squads in this group were also afforded the opportunity to interact with a 
company-level intelligence cell (CLIC) and a company-level operations cell (CLOC). 
The CLIC used space on the walls to hang up intelligence products that they created 
based on the information gained during the conduct of their patrols (Figure 49). The 
CLOC served as a Higher Headquarters to radio back to during the conduct of the patrol 
to coordinate operational concerns (Figure 50). 
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Figure 50. Intelligence sharing at the CLIC and Operations planning at the CLOC. 

D. RESULTS 

This section elaborates and comments the results that have been derived from the 
questionnaires fdled by the participants and evaluators; where applicable, we visualized 
those results in graphical form. 

1. Measurable Data 

Self-assessed knowledge of the participant’s knowledge of infantry tactics, 
techniques, and procedures: Figure 51 describes the basic knowledge of the participants 
from the self-assessed set of questions answered before the scenario training began 
(question numbers 8.1 through 8.7, Appendix J). At first glance one might speculate the 
control group scored themselves lower because of their non-infantry MOS and longer 
time period elapsed from basic training, where as the treatment group is younger and 
more recently graduated from their basic training. In any event, by examining the means, 
standard deviations and 1-way Test, ChiSquare Approximation score of 0.0017 < 0.05, it 
becomes clear that the treatment group is more confident in their abilities and knowledge 
of infantry tactics, techniques and procedures. 
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Oneway Analysis of Basic Knowledge By Group 


8 , 



Group 


Missing Rov«s 5 

Quantiles 

Level Miniimiin 10*o 25“o Median 75‘-» 90% Maxiiniiin 

Control 3.474576 3.474576 3.966102 3.983051 4.288136 4 457627 4 457627 

Treatment 4 566667 4.566667 4.6 4 966667 5 288889 5.366667 5.366667 

Means and Std Deviations 

Std Err 


Level Niiinbei Mean Std Dev Mean Lower 95% Upper 95% 

Control 7 4 04843 0.313205 0.11838 3.7588 4.3381 

Treatment 7 4 96850 0.319470 0.12075 4.6730 5.2640 

Wilcoxon / Kruskal-Wallis Tests (Rank Sums) 

(Mean- 

Level Count ScoieSnm Score Mean MeanOIStdO 

Control 7 23.000 4.0000 -3.070 

Treatment 7 77.000 11.0000 3.070 

2-Sample Test. Normal Approximation 
S Z Ptob>|Z| 

77 3.06998 0,0021* 

1-way Test. ChiSquare Approximation 
ChiSqiiare DF Piob>CliiSq 
9.8216 1 0.001 r 


Figure 51. Self-assessed knowledge baseline scores. 


Understanding of the mission: Figure 52 describes the participant’s level of 
understanding of their mission following each of the briefs prior to their stepping off for 
the patrol (question numbers 1-2 ‘After the Brief, Appendix J). By examining the means 
and standard deviations, we can see that the treatment group who utilized the SPOC, felt 
more confident than the control group about understanding their mission, and that their 
mission brief was well presented. Flowever, the 1-way Test, ChiSquare Approximation 
value of 0.1213 > 0.05 could refute that claim since it represents a poor fit. This value of 
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0.1213 therefore lessens the statistical significance of this finding. More sample data 
should be collected on the issue to further examine the true benefit of utilizing the SPOC 
to support mission understanding. 

Onewiy Ana ysis of Mission Understanding By Graup 



Quantiles 


Level 

Control 

Treatmieni 

Mriuiuiin 

5 08 

5 84 

10- 

508 

584 

25* 

508 

584 

Median 

518 

5915 

75* 

5 28 

6 05 

90*. 

5 28 

6 0S 

Mdximiin 

528 

605 

Means anOStd Deviations 









Std Err 




Level 

Nunber 

Mean 

SIC Dev 

Medii Lowei 9S' Jppei 9S‘ 


Control 

2 

518010 

0141421 

0 10000 

39094 

6 4506 


Treatmenl 

2 

5 945(0 

0 148492 

010500 

4 6108 

7 2792 



Wilcoxon /Kruskal-Wallis Tests (Rank Suns) 

<Mc.in 

Level Count Score Siiin Score Mean MeatiOISicIO 
Control 2 3 000 1 50000 -1 162 

Treatment 2 7 000 3 50000 1 162 

2-Sample Test. Normal Approximation 
s Z Prib>iZi 

7 1 16190 02453 

1-wav Test. ChiSquare Approximation 
CtiSqiiare Of ProLsCliiSq 

2 4000 1 01213 

Small sample sizes Refer to statistical tables for tests, rattier than 
larpe-sample appronmalons 


Figure 52. Self-assessed mission understanding and presentation clarity of the mission 

brief. 


Participant’s level of confidence; Figure 53 describes the participant’s level of 
confidence in completing their training tasks and their overall view of success in 
executing their mission (question numbers 10 [seven tasks] and 11 ‘After the Patrol,’ 
Appendix J). After examining the means and standard deviations, along with the 1-way 
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Test, ChiSquare Approximation value of 0.0008 < 0.05 we ean clearly see a good fit—the 
treatment group, after utilizing the SPOC for briefings and mission planning, felt more 
confident in completing their training tasks and that their view of achieving success in 
executing their mission was also higher. 


Oneway Analysis of Self Assessment By Group 



Ouant les 

Lei/el Miiiiniiin 10's 2f'<, Median 7S'< 90’° Maxirniin 

Control 3 836 8 7 9 3.83687 9 3.99 094 2 4 305 863 4 4 64 5 5 9 4 5 67 M2 4 567742 

Treatment 4 98 4 98 5.01 5 175 5 38 5.54 5 54 

Means and Std Devlatons 

Std Eri 

Le</cl Niiinbei Mean Std Dev Mean Lower 95'o Upper 95S 
Control 8 4 23606 0265514 0 03387 40141 4 4580 

Treatment 8 5 20125 0 209178 0 07396 5 0264 5 3761 

V7ilcoxon / Kruskal-Wallis Tests (Rank Sums) 

IMeaii 

Le\/el Count Score Sum Score Mean MeanOt StdC 
ConUol 8 36000 4 5000 -3.311 

Treatment 8 100 000 12.5000 3.311 

2-SaTiple Test. Normal Approximation 
S Z Prob>lZl 

100 3.31060 O.OOOO* 

1-way Test. ChiSquare Approximation 
CliiSqiiare OF Prcb>CliiSq 

113108 t 0 0008* 

Figure 53. Participant self-assessment on training confidence and overall success of the 

training. 


Computer Generated Actors: Figure 54 describes the participant’s overall level 
of belief that the Computer Generated Actors—CGAs (also described as virtual people) 
displayed on the wall, are equivalent to real role players (question number 18a through 
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18g, Appendix J). After examining the means and standard deviations, along with the 1- 
way Test and ChiSquare Approximation, there is no statistically significant difference 
between either of the groups. Both groups view the CGAs as somewhat real when 
compared to actual role players. It is our recommendation that the role of CGAa should 
be further studied in more detail. 

Oneway Analysis of CGA Interaction By Group 



Quantiles 


Level 

Control 

Treatment 

Miriirruiiri 

3 28 

3 348315 

10* 25”. Median 

3 28 3 45 3 52 

3 348315 3 434783 3 704082 

75*, 

397 

3 84 

90- 

4 13 

3 88761 

Maxittiirn 

4 13 

3 88764 

Means and Std Deviations 




Level 

Control 

Treatment 

Niitrtber 

7 

7 

Std Err 

Mean Std Dev Mean Lower 95’: 

3 640(0 0.304083 01'493 3 3588 

3 62938 0 214280 0 0(099 3 4312 

Upper 95”- 
3 9212 

38276 



Wilcoxon / Kruskal-Wallis Tests (Rank Sums) 

Level Count Score Sum Score Mean MemOl McIO 
Control 7 5 3 000 ' 57143 -0 JOO 

Treatment 7 5 2 000 M2857 0 DOO 

2-Sample Test. Normal Approximation 
S l Prjb>/| 

52 0 00000 1 0000 

1-way Test. ChiSquare Approximation 
ChlSquiie OF Prot'>ClilSq 

0 0341 1 0 9491 

Figure 54. CGAs are only seen as almost somewhat real when compared to actual role 

players. 


Training effectiveness; Figure 55 describes the participant’s overall view on the 
training effectiveness offered at the IIT (question numbers 19-21 [At the conclusion of 
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training {i.e., in the last ‘After the Patrol’ section}], Appendix J). After examining the 
means and standard deviations, along with the 1-way Test, ChiSquare Approximation, it 
appears that both groups feel strongly that the IIT is an effective way to train how to 
patrol in an urban environment. Of note, we can see one outlier in the control group and 
its increased dispersion among ratings. The treatment group has a good fit, and both 
groups are of the opinion that the training at the IIT helps to improve urban patrolling. 
We can also state that both groups view the IIT as a way to improve their information¬ 
gathering skills. 


Oneway Analysis of IIT Training Effectiveness By Group 



Quantiles 

Level Miiiiimim 10'; Median 90' Miixinuiin 

Control 511 511 5 58 617 6 305 6.38 6.38 

Treatmenl 5 923077 5 923077 6 024038 6.128571 6 361111 6 402778 6 402778 

Means and Std Deviations 

Sid Ell 

Level Niiiiibei Mean Std Dev Mean loweiQS"! UppeiQS'i 

Control 5 5 98800 0 504995 0.22584 5 3610 6 6150 

Tieatment 5 6 17977 0187586 0 08389 5 9469 6 4127 

Wilcoxon / Kruskal-Wallis Tests (Rank Sums) 

(Medii- 

Level Count ScoieSiiiri ScoieMean MeanOIStdO 
Control 5 26 000 5 20000 -0 209 

Treatment 5 29 000 5 80000 0 209 

2-Saiiiple Test. Normal Approximation 
s z Piob>|Z| 

29 0 20889 0 6345 

“l-wav Test. ChiSquare Approximation 
CliiSqiidie DF Pioli>CliiS(| 

0 0982 1 0 7540 


Small sample s izes Refer to statistical tables ferte sis. rather than 
large-sample approximalorts 


Figure 55. Participant view of training effectiveness at the IIT. 
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Squad communication (evaluator’s rating): Figure 56 describes the evaluator’s 
ratings of the squad’s communication amongst the patrol and to their Higher 
Headquarters during their patrol (question numbers 1 and 2 ‘After the Patrol’, Appendix 
K). As one can see by evaluating the means, standard deviations and 1-way Test, 
ChiSquare Approximation, there is no statistically significant difference between the two 
groups. Both groups performed poorly in this aspect during their training. It is our 
recommendation that training emphasis be placed on improving communication during 
this urban training while at the IIT, since communication is a critical aspect of the 
intelligence cycle and has a tremendous impact on situational awareness. 
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Level Minimiitn 10' 26' Medidn 75' 90* Miixitniitn 

ConUol 1 85 1 85 1 86 2 7 3 55 3 55 3 55 

Trealnnenl 2 883721 2 883721 2 883721 3 324839 3 765957 3 765957 3 765957 

Means and Std Deviations 

Std Ell 

Level Niiinbei Mean Std Dev Mean IOMei95* Uppei 95* 

Control 2 2 70000 1 20208 0 85000 -8100 13 500 

Trealmeni 2 3 32484 0 62384 044112 -2 280 8 930 

Wiicoxon / Kruskal-Wailis Tests (Rank Sums) 

(Mean 

Level Coinii ScoieSiiin ScoieMean MeanO)StiiO 
ConUol 2 4 000 2 OOOOO -0 397 

Trealmeni 2 6 000 3 00000 0 387 

2-Sample Test. Normal Approximation 
s Z Piob>|Zt 

6 038730 06985 

1-wav Test. ChiSquare Approximation 
ChiScinaie OF Piob>CliiSq 
0.6000 1 0 4386 

Small sample sizes Referto stailstical tables fortests. ratherthan 
large-sample approximakins 

Figure 56. Evaluator ratings on squad communication during the patrol. 


Overall team rating (evaluator’s rating): Figure 57 describes the evaluator’s 
overall rating regarding positive performance by the squad during their patrol (question 
numbers 13 through 18 and 20 ‘After the Patrol’, Appendix K). By evaluating the means 
and standard deviations we do not see a statistically significant difference among the two 
groups. However, after analyzing the 1-way Test, ChiSquare Approximation we can see 
that 0.004 < 0.05 and the difference is noteworthy. Therefore, the treatment group. 
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utilizing the SPOC, did receive a more positive performance rating when compared to the 
control group through analysis with the 1-way Test, ChiSquare Approximation. This area 
of our research requires further investigation. The questions that one could ask are: was it 
the difference in MOS or the utilization of the SPOC that caused this difference? Also, in 
order to determine if the difference is statistically significant one would need a larger 
sample size. 


Oneway Analysis of Positive Performance By Group 



Quantiles 

Level MiiMnnnn 10' 25” Median 75S 90'r Maxuiwnn 

Control 3 68 3 68 378 4 35 4 51 4 74 4 74 

Treatment 4 663061 4 663061 4 693878 6 364167 6 468086 6 623449 6 622449 

Means and Std Deviations 

Sid Ell 

level Nninbei Mean Sid Dev Moan lawei95'- Uppei 95' 

Control 7 4 20000 0 400866 015144 3 8294 4 5706 

Treatment 7 5 21325 0 381561 014422 4 8604 5 5661 

Wilcoxon / Kruskal-Wallis Tests (Rank Sums) 

(Mean 

level Coiiiil Score Slim Score Mean Me<uiO) S1dO 

Control 7 30 000 4 2857 -2 814 

Treatment 7 75 000 10 7143 2 814 

2-Sample Test. Normal Approximation 

S Z Piob>iZ| 

75 2 81415 00049 ' 

1-wav Test. ChiSquare Approximation 
ChiSqiiate DF Pfob>Clii6q 

8 2835 1 0 0O4ir 

Figure 57. Evaluator ratings on positive performance. 


Negative trends in team performance (evaluator’s rating): Figure 58 describes 
the evaluator’s overall view on rating negative performance by the participants (question 
numbers 19, 21 and 22 ‘After the Patrol’, Appendix K). By examining the means. 


no 












standard deviations and 1-way Test, ChiSquare Applieation, we can affirm there is no 
statistically significant difference among the two groups. Of interest however, is the 
dispersion and low scoring of the treatment group. This could be explained by the bias of 
the evaluators observing the treatment group. These evaluators have years of experience 
in infantry tactics, techniques and procedures; which might raise their levels of 
expectation for the participants in the treatment group during the training. 



Level Minitniim 10- 25*- Medidti 75*< 90*- Maximum 

Control 2 542857 2 5-42857 2 542857 2 555556 4 75 4 75 4.75 

Treatment 1 77551 1 77551 1 77551 1 891304 4 723404 4 723404 4 723404 

Means and Std Deviations 

5ld Ell 

l evel Niimbei Mean Std Dev Mean Lower 9S'> Upper 95'. 

Control 3 328280 1 27064 0 73361 0126 64393 

Treatment 3 2 79G74 1 86954 0 98391 -1 351 8 9441 

Wiicoxon / Kruskal-Watlis Tests (Rank Sums) 

(MPiin- 

Level Cotiirt Score Sum Score Mean Me.wOiStdO 
Conirol 3 13 000 4 33333 0 873 

Treatment 3 8 000 2 66667 -0 873 

2-Sample Test. Normal Approximation 

S Z Prob>lZ| 

8 -0 87287 0 3827 

1-waf Test. ChiSquare Approximation 

ChiSquare OF Ptob>CliiSq 

1 1905 1 0 2752 

Small sample sizes Referto statistlcaitablesrortesls.ratherthan 
large-sample approramakns 

Figure 58. Evaluator ratings on negative performance. 
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E. DISCUSSION 


The objectives for this study were to see if the introduction of deliberate 
intelligence activities and the introduction of a dedicated planning center supported by 
suitable technologies improved team performance. An important goal for the study was 
also to collect information and discover any fallacies and shortcomings of the setup that 
could be used for further stages of this line of research. The most significant aspect of 
these observations is the setup of the evaluator and participant forms, and how to 
interpret the answers to selected questions. 

The primary purpose of this study was to validate the need for an emphasis on the 
integration of the intelligence cycle supported by advanced technological solutions, to 
conduct more successful training of the units in the IIT. Our pilot study helped us build a 
necessary knowledge related to the specially designated space that will be used by the 
unit — we created a Squad Planning Operations Center (SPOC) within the confines of 
the IIT for the Marine’s to receive and conduct their Operations/Intelligence Briefs and 
After Action Reviews (AARs)/Debriefs. 

In general, squads do not require a tremendous amount of technical data to 
prepare for their patrols. Instead, they need easy access to a sand table or terrain model to 
talk through their plan. This is not to say that technology cannot support the squad, 
because it can. The technology just needs to be user-friendly and easy to comprehend in a 
short period of time. The squads would rather spend their rehearsal and planning time 
talking and walking through their standard operating procedures (SOPs). This is due to 
the high level of uncertainty they must prepare for. Pictures and other images that squad 
members can take with them are useful — they can put this material in their pockets to 
review as time and situation allows. They are also able to compare the pictures they may 
have on them to the people that they meet while on patrol, rather than trying to recall 
from memory. In urban environments, these factors significantly increase and quickly 
become a challenge if not managed correctly. 

An item of interest regarding the SPOC was that the company-level intelligence 
cell (CLIC) and company-level operations cell (CLOC) fit very nicely into the 
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arrangement for manning purposes. The information proeess, utilizing the SPOC, 
improved situational awareness for planning and sharing of intelligence, thus reducing 
uncertainty for the patrol, while simultaneously generating tempo for the unit. 

One question that must be addressed is how can we man and maintain the SPOC 
concept at the IIT? The answer to this question will get us one step closer to improving 
immersion training for the infantry squads. 

1. Limitations and Challenges 

We discovered the following limitations and challenges: 

• The IIT is a training facility — therefore, the unit decided on what scenario to use, 
we did not have any influence 

• IIT VIP visits take priority over the research effort—sometimes pausing the 
training 

• Uncertainty plays a factor, given that infantry tasks are complex and dynamic — 
therefore, the scenarios can never be fully scripted and are often different from 
one patrol to the next 

To mitigate these limitations, one must maintain the continuous support from the I 
MET and IIT personnel, and should maintain close collaboration with the subject matter 
experts on site for support. 

To find units willing to support this research, prior coordination was a necessity. 
It was essential to maintain good communication with the training units so that we did 
not interfere with their training objectives while at the same time ensuring we were able 
to support our study goals. 

2. Conclusion 

The data collected in this study and our statistical analysis of that data suggests 

that the treatment group began and ended the study as the more confident group. This 

should not be a surprise due to this group being younger and more confident in their 

infantry skills, having more recently graduated from their MOS training, and more 
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frequently eondueting infantry speeifie training. Of interest, however, is the positive 
pereeption for understanding the mission from the mission brief within the eonfines of 
the SPOC. Until we eompare two groups of the same MOS, under the same seenarios, we 
will not be able to aseertain seientifioally if the SPOC was the eause of this finding. 

F. ADDITIONAL DOCUMENTATION 

This seetion elaborates the items ereated by the CLIC within the spaee of the 
SPOC to support the training seenarios utilized during this study (Figures 59 through 62). 
These produets, among several others deseribing threat weapons and enemy taeties, 
teehniques and proeedures (TTPs) were ereated by the Marine’s within the CLIC on their 
own initiative to add to the training. The instruetor staff did not prompt this aetivity. This 
information was derived during the eourse of the patrol and later shared during the 
eonduet of the patrol debriefs. The information was then analyzed for intelligenee value, 
to be produeed into this usable format for dissemination, and ultimately for utilization 
while on patrol for the Marines. 

Figure 59 shows a number of the intelligenee produets ereated by the CLIC 
during the eourse of the training. Eaeh of these items was made available to the squads 
during their mission planning. Figure 60 shows a Marine analyzing the data eolleeted to 
make valid assessments to elarify and drive the training scenario. Figure 61 was created 
based on the information provided during a patrol debriefing and Figure 62 was created 
based on actual historical data to add realism to the training scenario. 
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Figure 59. Enemy TTPs disseminated to 
support the patrolling squads. 
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Figure 61. An intelligence product to support 
identification of a HVI during patrol. 



Figure 60. A CFIC Marine works to produce an 
intelligence product. 
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Figure 62. lED TTPs disseminated to support 
the intelligence effort. 
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VIII. RELATED WORKS 


A. X3D MODEL OF IIT 

Figure 63, created by the author, shows a 3D model of the IIT and was used to 
brief the participants during their orientation brief. This work could also be used for 
mission planning or AAR. An advantage of this data format is that it is web-based and 
could easily be shared with incoming units to conduct initial planning for their training at 
the IIT. A disadvantage, although minimal because of its intuitive nature, is that users 
would need to download X3D viewer and become familiar with its controls for 
navigation. 



Figure 63. X3D model of the IIT. 


Figure 64, generated using a viewpoint that is positioned at the level of an 
imagined enemy eye view illustrates the value of having a live-size 3D model of the 
environment and its potential advantages over a miniature replica (i.e., terrain model) of 
the environment, where one cannot see first-person view from street level. 
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Figure 64. X3D street level viewpoint of the IIT model. 


B. OTHER RELATED MATERIAL 

Figure 65, provided by the IIT technological staff, shows a realistic-looking 3D 
model of the IIT and must be run in the Gamebryo application programming interface 
(API). This work could also be used for mission planning or AAR, and even has the 
potential to be further developed into a first person shooter game. An advantage of this 
data format is that it is a well-architected API that is designed to deliver outstanding 
performance with true multi-core/multi-platform capabilities. Gamebryo automatically 
handles nearly every animated value that can be specified when exporting from popular 
digital content creation tools. In addition, Gamebryo’s Animation Tool lets the user blend 
between an arbitrary number of animation sequences. The new Emergent Terrain System 
extends the users palette and supports industry standard products like PhysX and 
SpeedTree. Gamebryo provides all the rendering, animation and special effects features 
the user needs to create any genre of game (Emergent Game Technologies, 2009). 
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Figure 65. Gamebryo 3D model of IIT. 


Similar to the X3D model, Figure 66 generated using a viewpoint that is 
positioned at the level of a Marine’s imagined eye view illustrates the value of having a 
live-size 3D model of the environment and its potential advantages over a miniature 
repliea (i.e., terrain model) of the environment, where one eannot see first-person view 
from street level. 
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IX. CONCLUSIONS AND RECOMMENDATIONS 


A. INTRODUCTION 

This chapter provides a eomprehensive summary of all major results and 
eonelusions made in this thesis. The text also elaborates a set of reeommendations for 
future training in IIT as well as our suggestions for future researeh topies to be pursued 
with the goal of making the training in augmented environments more effeetive. 

B. CONCLUSIONS 

Based upon the researeh eondueted in support of this thesis, it has beeome evident 
that to best support infantry immersion training, one should move away form the 
prevalent teehnology-centered approach, to a more beneficial training-objective (user) 
eentered approaeh in training situations, where the use of innovative teehnical solutions is 
present to meet training objeetives. 

The need for eontinued immersion training for the infantry is evident. Current and 
future eonfliets require improved eombat preparation skills for the infantryman. We must 
strive towards simulation training for the infantry that meets the following requirements 
(but not limited to): 

• Available for infantry units training aboard our major bases. 

• Inoculates the rifleman with the sights, sounds, smells, and ehaos of battle. 

• Inereases situational awareness skills. 

• Tests moral, ethieal and legal deeision making. 

• Trains small units to fight as one “weapon system.” 

• Trains the Marines to operate in an urban environment among innoeent 
eivilians. 

Based on the information gained from this study it has beeome evident that an 
environment needs to be created where we are not serving technology, but instead, 
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technology is serving us. To train correctly in this newly proposed manner, a process 
should be implemented where there is a shift from technology-centered activity to user- 
centered activities that provide tangible gains for the intended users. 

The goal for this simulation-based training is to provide each Marine with a sense 
of combat prior to deploying into a combat environment. By continuing to push the ball 
forward from the already established IIT accomplishments, we can increase the 
effectiveness of immersion training for the infantry and will create a more confident and 
effective combat decision maker even under the most complex circumstances. We can 
also expect a better trained Marine who is able to diminish (ultimately, eliminate) 
friendly and innocent casualties by reducing collateral damage while accomplishing the 
mission at hand. 

C. RECOMMENDATIONS FOR FUTURE IIT TRAINING 

The observations conducted in preparation for and during the main study provided 
us with invaluable material and insights that could not have been possible to gain 
otherwise. As a result of that work and the results produced in our main study, we are 
able to make several recommendations related to the training that is conducted in IIT. 

I. Scenario Support 

The question of scenarios and the need to present appropriate (good) scenarios in 
particular order to the unit became evident very quickly during our observation. It is our 
recommendation that the IIT staff develops and tests a list of scenarios from easiest to 
hardest difficulty level before they get approved for use in IIT. The squad leader must 
reach a pre-established level of proficiency before moving to the next level. This will 
allow the platoon leadership to truly measure the proficiency of its squad leaders. By 
letting the IIT staff select the scenarios used in the training, an element of bias can be 
removed from the training. The goal for the platoon will be to reach its desired level of 
proficiency prior to its deployment. 
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2 . 


Permanent Terrain Model 


Terrain models have always served as an effeetive planning tool for the military. 
These models allow for a quiek overview of a eertain area. However, terrain models often 
take time to eonstruet and therefore must be prepared well in advanee, before planning 
ean oeeur over the model. Currently, eomputer-based systems that deal with the terrain 
models allow produetion even in a very short time, assuming the needed raw data, 
ineluding 3D data sets and a digital terrain model, already exist. A realistie model of the 
environment enables the user to memorize the details mueh better than a map and 
minimizes the risk of ineorreet reading of a map. In addition, sueh models allow for an 
easy deteetion of a field of view from eaeh point inside the 3D environment, something 
that is very important in war situations, and something that is not so easy to determine 
from a 2D map. It is also possible to easily evaluate the eoverage of a fire position. 

An improvement to the training at the IIT would be to simply provide a terrain 
model to the squads for their Confirmation Briefs. As seen in Figure 67, the Marines 
were foreed to build a terrain model out of MRE boxes to support their planning efforts. 
The training value for building this terrain model was ineonsequential beeause only the 
first patrol group on day one built it. The rest of the treatment group merely used the pre¬ 
existing terrain model to support their planning efforts. Value eould be added for 
supporting the planning proeess at the squad level by working from an existing, generie 
terrain model. Another alternative would be to have a digital 3D model that the unit eould 
review (navigate through) on a large sereen, perhaps even having a eombination of a 
physieal motion eapture model of the village (i.e., like the one built by the unit) and a 
digital 3D model that they ean look at and navigate through if they want to enable elose 
inspeetion of some position inside the 3D model (i.e., field of view from some position, 
or similar). 
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Figure 67. Squad Leader giving his Confirmation Brief over terrain model made of MRE 

boxes. 


3. Grading System/Report Card 

A standardized evaluation of the training at the IIT would most likely add training 
value and will likely inerease the validity of the training. Similar to other simulation- 
based training, it is often appropriate to offer a variety of levels of expertise for the 
partieipants to progress through. To standardize the squad leader evaluation proeess, an 
evaluation system should be established. As a part of the framework we are proposing, 
the squad leader and his squad would be graded on the following performanee traits 
(some other traits may be added, depending on the training objeetives the unit ehooses to 
address in their IIT training): 

• Seeurity 

• Dispersion 

• Communication 

• Body Language 

• Control 

• Teamwork 

The suggested grading scale could be A through F, with A equaling 4.0 and F 
equaling 0. There would be three levels of difficulty for the scenarios (represented as 
GREEN = no enemy contact/engage with locals, YEELOW = small arms fire 
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engagement, and RED = lED and/or RPG attaek.) The IIT instruetor overseeing the 
squad training would randomly seleet an already established seenario at the speeified 
level of diffieulty while still meeting the pre-established training objeetives set forth by 
the training unit’s leadership. 

If the unit is going through the IIT training environment for the first time, a squad 
leader (i.e., entire unit) would begin with a GREEN level seenario. To move to a 
YEEEOW level seenario, the squad leader (unit) must aehieve a grade equal to or greater 
than 3.0. The 3.0 seale would also apply to the YEEEOW level seenario before being 
allowed to move to a RED level seenario. A unit’s goal would be to aehieve all RED 
level squad leaders. If the squad leader (unit) were to seore below a 3.0 on two 
eonseeutive YEEEOW or RED level seenarios then the squad leader would be required to 
drop a level and reestablish his grading report eard status. In addition to these grading 
eriteria, the MEFs five “Habits of Aetion” would also be enforeed on a Pass/Fail basis. 
These five “Habits of Aetion” are: 

1. Pre-eombat eheeks/inspeetions 

2. Rehearsals 

3. Confirmation Briefs 

4. After Aetion Reviews (AARs) 

5. Debriefs 
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Figure 68 diagrams our proposed Squad Leader Report Card for the III. 
Instructor notes and additional instructions could be placed on the backside. 


THb 


IT 

laMlLMteApat 

ted 

Fatro 1 

Patrol 2 

PattDl 3 

Patrol 4 

Patrols 

IhaActet* 

P/F 

P/F 

P/F 

P/F 

P/F 

Kihliteii 

P /t 

P/h 

P/F 

P/h 

P/h 


P/F 

P/F 

P/F 

F/F 

P/F 


AB CDF 

AB CDF 

AB C DF 

ABCD F 

AE cor 


AB CDF 

AB CDF 

AB C DF 

ABCD F 

AE CDF 


AB C D F 

AB C D F 

AB C D F 

AB C D F 

AE C D r 


AB CDF 

AB C D F 

AB C DF 

ABCD F 

AE CDF 


AB CDF 

AB CDF 

AB C DF 

ABCD F 

AE CDF 


AB CDF 

AB CDF 

AB C DF 

ABCD F 

AE CDF 


P/F 

P/F 

P/F 

F/F 

P/F 

Btetildfiadi 

PMiLiMiee 

ft 

lY 

ftVK 

ftVK 

ftVM 












Figure 68. Proposed Squad Leader Report Card for the III. 


4. Facility Upgrades/Improvements 

In the case of the IIT and the training that is conducted there, the size of the 
environment influences the range of actions and operations that the unit can achieve 
there. The proper distance to establish a cordon around an lED is 300 meters. The current 
set-up of the IIT does not allow that to occur. We also recommend a permanent space set 
aside for the establishment of the SPOC. The Squad Planning Operations Center should 
be constructed in such a manner that supports the arrival and training of an infantry 
squad, whether or not its platoon or company is on site. The idea behind the development 
of the IIT was to support the infantry squads. All aspects of the training should allow for 
a squad leader who chooses to bring his squad to the facility for training, to be allowed to 
conduct the necessary training without any additional outside support other than the IIT 
staff and its associated personnel. 

a. Squad Planning Operations Center — SPOC 

Figure 69 depicts our layout for the SPOC during the main study using the 
treatment group. The SPOC contains all necessary equipment to support the realistic 
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training at the IIT, to include communications with the squad, intelligence activities and 
operational concerns. Ideally, manning for the SPOC would come from the training unit’s 
leadership. 



Figure 69. Squad Planning Operations Center (SPOC) layout during the main study at the 

IIT. 


b. Health Concerns 

A concern observed during our research at the IIT was the effect of the dirt 
inside the training environment on its permanent personnel after prolonged exposure. To 
make the training more realistic, dirt covers the floors and, as activity takes place, the dirt 
gets kicked up into the air. It was observed that one member of the IIT staff developed 
eye and sinus trouble as a negative reaction. To mitigate this concern, air filters have 
been added to help assist in clearing the air more quickly. Although the issue has been 
addressed, it is our recommendation that the situation continue to be studied, as the air 
filters will likely require close monitoring and frequent replacement. Strain on the air 
filter machines may also become costly over time. 

D. RECOMMENDATIONS FOR FUTURE RESEARCH 

This section provides a short list of recommended topics for future research 
opportunities. 
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Future research topics suggested by this thesis include, but they are not limited to: 

1. Further integration of intelligence products in training: intelligence 
products need to have already been through the intelligence cycle so they 
have reached the utilization phase for the patrolling unit. Our 
recommendation is to conduct further research onsite at the IIT with 
squads forming as the participant pool, similar to our main study. 
Intelligence products should be created to rapidly support understanding 
of the situation and utilized for planning (i.e., on a sand table or terrain 
model). 

2. Increase sample size: we would also recommend conducting a study with 
more groups of participants with the same MOS and age group utilizing 
the same scenarios for each squad. 

3. Training effectiveness study: we recommend designing and organizing a 
training effectiveness study, that would include unit performance test prior 
to and after the IIT training, to evaluate performance improvement. 
Donald Kirkpatrick’s (Kirkpatrick, 1994) training evaluation model would 
be a very good guide to follow for this research. 

4. Automated training support evaluation system: our vision for the IIT is to 
implement a system that conducts automated (system supported) behavior 
analysis as an augmentation of human monitoring that usually happens in 
IIT. By using the appropriate sensor system, the movements of each 
Marine could be tracked and information about selected performance traits 
of each team member could be derived. Additionally, one would also want 
to record and analyze all radio and face-to-face communications passed 
among Marines and provide an automated understanding about that type 
of information as well. 

5. Autonomous actors in training simulations: our vision includes an 
augmented environment with the combination of real-world (live person 
or robotic device) and computer-generated data (virtual reality/avatar 
support), where the computer graphics objects are blended into the real 
(physical) world of the user and the user not needing a special device (eye 
gear) to experience this mix. 


128 



APPENDIX A—FM 7-8 REACT TO CONTACT BATTLE DRILL 


TASK: React to Contact (Platoon/Squad) (07-3-D9103) 

CONDITIONS: The platoon/squad is halted or moving. The enemy initiates fires on the 
platoon/squad with an individual or crew-served weapon. 

STANDARDS: The unit returns fire immediately. The unit locates and engages the 
enemy with well-aimed fire and causes at least one enemy casualty. The leader can point 
out at least one-half of the enemy positions and identify the types of weapons (such as 
small-arms, light machine gun). 


Task Number 
071-311-2007 
071-311-2027 
071-311-2029 
071-311-2127 
071-311-2129 
071-311-2130 
071-312-3029 
071-312-3031 
071-325-4407 
071-326-0502 
071-326-0503 

071-326-0511 
071-326-0513 
181-906-1505 

181-906-1505-A 

STP 7-1 IBCl-SM-TG 071-052-0006 

071-054-0004 
071-312-4027 
071-326-0501 
STP7-11BC24-SM-TG 071-052-0006 

071-054-0004 
071-312-4027 
071-326-0501 
071-326-5611 
071-326-5630 
071-420-0005 
STP 7-1 IBCHMl-SM 071-052-0006 

071-054-0004 

071-312-4027 

071-326-0501 


Task Title 

Engage Targets with an M16A1 or M16A2 Rifle 
Load an M16A1 or M16A2 Rifle 
Correet Malfunetions of an M16A1 or M16A2 Rifle 
Load an M203 Grenade Launeher 
Correet Malfunetions of an M203 Grenade Launeher 
Engage Targets with an M203 Grenade Launeher 
Correet Malfunetions of an M60 Maehine Gun 
Engage Targets with an M60 Maehine Gun 
Employ Hand Grenades 
Move Under Direet Fire 

Move Over, Through, or Around Obstaeles (Exeept 
Minefields) 

Reaet to Flares 

Seleet Temporary Fighting Positions 
Conduet Combat Operations Aeeording to the Law of 
War 

Conduet Combat Operations Aeeording to the Law of 
War 

Engage Targets with an M47 Medium Antitank 
Weapon 

Engage Targets with an Ml36 Launeher 
Load an M249 Maehine Gun 
Move as a Member of a Fire Team 
Engage Targets with an M47 Medium Antitank 
Weapon 

Engage Targets with an Ml36 Launeher 
Load an M249 Maehine Gun 
Move as a Member of a Fire Team 
Conduet the Maneuver of a Squad 
Conduet Movement Teehniques by a Platoon 
Conduet the Maneuver of a Platoon 
Engage Targets with an M47 Medium Antitank 
Weapon 

Engage Targets with an Ml36 Launeher 
Load an M249 Maehine Gun 
Move as a Member of a Fire Team 


References 

STP21-1-SMCT 
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References Task Number 

STP7-11BCHM24-SM-TG 071-326-5611 

071-326-5630 

071-420-0005 


ILLUSTRATIONS: N/A 


Task Title 

Conduct the Maneuver of a Squad 
Conduct Movement Techniques by a 
Platoon 

Conduct the Maneuver of a Platoon 


TASK STEPS AND PERFORMANCE MEASURES: 

1. Soldiers immediately assume the nearest eovered positions. 

2. Soldiers return fire immediately on reaehing the covered positions. 

3. Squad/team leaders locate and engage known or suspected enemy positions with well 
aimed lire, and pass information to the platoon/squad leader. 

4. Fire team leader’s control the lire of their soldiers by using standard lire commands 
(initial and supplemental) containing the following elements: 

a. Alert. 

b. Direction. 

c. Description. 

d. Range. 

e. Method of lire (manipulation and rate of lire), 
f Command to commence tiring. 

5. Soldiers maintain contact (visual or oral) with the soldiers on their left or right. 

6. Soldiers maintain contact with the team leader and indicate the location of the enemy 
positions. 

7. The leaders (visually or orally) check the status of their personnel. 

8. The squad/lire team leaders maintain visual contact with the platoon/squad leader. 

9. The platoon/squad leader moves up to the squad/fire team in contact and links up with 
its leader. 

a. The platoon leader brings his RATELO, platoon FO, the squad leader of the 
nearest squad, and one machine gun team. 

b. The squad leader of the trail squad moves to the front of his lead fire team. 

c. The platoon sergeant moves forward with the second machine gun team and 
links up with the platoon leader, ready to assume control of the base-of-fire element. 

10. The platoon/squad leader determines whether or not his unit must move out of the 
engagement area. 

11. The platoon/squad leader determines whether or not his unit can gain and maintain 
suppressive fires with the element already in contact (based on the volume and accuracy 
of enemy fires against the element in contact). 

12. The platoon/squad leader makes an assessment of the situation. He identifies— 

a. The location of the enemy position and obstacles. 

b. The size of the enemy force engaging the unit in contact. (The number of 
enemy automatic weapons, the presence of any vehicles, and the employment of indirect 
fires are indicators of enemy strength.) 

c. Vulnerable flanks. 

d. Covered and concealed flanking routes to the enemy positions. 
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13. The platoon/squad leader determines the next eourse of aetion (for example, fire and 
movement, assault, breach, knock out bunker, enter and clear a building or trench). 

14. The platoon/squad leader reports the situation to the company commander/platoon 
leader and begins to maneuver the unit. 

15. The platoon leader calls for and adjusts indirect fire (mortars or artillery). (Squad 
leaders relay request through the platoon leader.) 

16. Leaders relay all commands and signals from the platoon chain of command. 

17. The platoon sergeant positions the BFVs to observe and to provide supporting fires. 
NOTE: Once the platoon has executed the React to Contact Drill, the platoon leader 
makes a quick assessment of the situation (for example, enemy size, location). He decides 
on a course of action. The platoon leader reports the situation to the company 
commander. 


SUPPORTED T&EO'S 


ARTEP NUMBER T&EO NUMBER 

ARTEP 7-10-MTP 07-2-1045 

07-2-1081 

07-2-1090 

07-2-1135 

07-2-1270 

07-2-1279 

07-2-1315 

07-2-1342 

07-2-1369 

07-2-1468 

07-2-1477 

07-2-1486 


07-2-2009 

07-2-2027 

ARTEP 7-12-MTP 07-2-1045 

07-2-1081 

07-2-1090 

07-2-1135 

07-2-1270 

07-2-1279 

07-2-1315 

07-2-1342 

07-2-1369 

07-2-1468 

07-2-1477 

07-2-1486 


T&EO TASK TITUE 

Conduct a Defense (Infantry Company) 

Conduct a Link-up (Infantry Company) 

Conduct a Movement to Contact 

(Antiarmor/Infantry Company) 
Conduct a Raid (Infantry Company) 

Conduct an Infiltration or Exfiltration 
(Infantry Company) 

Conduct Convoy Escort 

(Antiarmor/Infantry Company) 
Conduct Patrol Operations (Infantry 
Company) 

Conduct Tactical Movement (Infantry 
Company) 

Cross a Water Obstacle (Dismounted) 

(Infantry Company) 

Take Action on Contact (Infantry Company) 
Breach an Obstacle (Infantry Company) 

Conduct Operations with Armored or 

Mechanized Infantry Vehicles in an 
Urban Environment (Infantry Company) 

Conduct a Route Reconnaissance (Infantry 
Company) 

Establish Observation Posts (Infantry Company) 
Conduct a Defense (Infantry Company) 

Conduct a Link-up (Infantry Company) 

Conduct a Movement to Contact 

(Antiarmor/Infantry Company) 
Conduct a Raid (Infantry Company) 

Conduct an Infiltration or Exfiltration (Infantry 
Company) 

Conduct Convoy Escort (Antiarmor/Infantry 
Company) 

Conduct Patrol Operations (Infantry Company) 
Conduct Tactical Movement (Infantry Company) 
Cross a Water Obstacle (Dismounted) (Infantry 
Company) 

Take Action on Contact (Infantry Company) 
Breach an Obstacle (Infantry Company) 

Conduct Operations with Armored or 

Mechanized Infantry Vehicles in an 
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Urban 

Company) 

07-2-2009 

07-2-2027 


ARTEP NUMBER T&EO NUMBER 

ARTEP 7-4-MTP 

07-3-1081 

Platoon/Squad) 

07-3-1090 

Platoon/Squad) 

07-3-1144 


07-3-1153 

Platoon/Squad) 

07-3-1189 


07-3-1216 

Platoon/Squad) 

07-3-1270 

(Antiarmor/Infantry/Mortar/Reconnaissance 
Platoon/Squad) 

07-3-1288 


07-3-1432 

Platoon/Squad) 

07-3-2000 

Platoon/Squad) 
ARTEP 7-5-MTP 

07-3-1027 

07-3-1054 

07-3-1081 

Platoon/Squad) 

07-3-1090 

Platoon/Squad) 

07-3-1126 

07-3-1144 


07-3-1153 

Platoon/Squad) 

07-3-1189 


07-3-1216 

Platoon/Squad) 

07-3-1225 

07-3-1243 


Environment (Infantry 

Conduct a Route Reconnaissance (Infantry 
Company) 

Establish Observation Posts (Infantry Company) 


T&EO TASK TITLE 

Conduct a Link-up 

(Infantry/Mortar/Reconnaissance 

Conduct a Movement to Contact 

(Infantry/Reconnaissance 

Conduct a Screen (Infantry/Reconnaissance 
Platoon/Squad) 

Conduct a Security Patrol 

(Infantry/Reconnaissance 

Conduct Actions at Danger Areas 

(Infantry/Reconnaissance Platoon) 

Conduct an Infiltration or Exfiltration 
(Infantry/Reconnaissance 

Conduct Tactical Movement (Mounted or 
Dismounted) 


Cross a Water Obstacle (Dismounted) 
(Infantry/Reconnaissance 
Platoon/Squad) 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Conduct a Route Reconnaissance 
(Infantry/Reconnaissance 

Breach an Obstacle (Infantry Platoon/Squad) 
Conduct a Defense (Infantry Platoon/Squad) 
Conduct a Link-up 

(Infantry/Mortar/Reconnaissance 

Conduct a Movement to Contact 

(Infantry/Reconnaissance 

Conduct a Raid (Infantry Platoon/Squad) 

Conduct a Screen (Infantry/Reconnaissance 
Platoon/Squad) 

Conduct a Security Patrol 

(Infantry/Reconnaissance 

Conduct Actions at Danger Areas 

(Infantry/Reconnaissance Platoon) 
Conduct an Infiltration or Exfiltration 
(Infantry/Reconnaissance 

Conduct Convoy Escort (Infantry Platoon/Squad) 
Conduct Operations with Armored or 

Mechanized Vehicles in an Urban 
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Environment 

Platoon/Squad) 


(Infantry 


07-3-1270 


Conduct Tactical Movement (Mounted or 
Dismounted) 


(Antiarmor/Infantry/Mortar/Reconnaissance 
Platoon/Squad) 



07-3-1288 

Platoon/Squad) 

07-3-1432 

Platoon/Squad) 

07-3-2000 

Platoon/Squad) 

ARTEP 7-7J-MTP 

07-3-1027 

07-3-1054 

07-3-1081 

Platoon/Squad) 

07-3-1090 

Platoon/Squad) 

07-3-1126 

07-3-1144 

ARTEP NUMBER 

T&EO NUMBER 

07-3-1153 

Platoon/Squad) 

07-3-1189 


07-3-1216 

Platoon/Squad) 

07-3-1225 

07-3-1243 

Environment 

Platoon/Squad) 

07-3-1270 


Cross a Water Obstacle (Dismounted) 
(Infantry/Reconnaissance 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Conduct a Route Reconnaissance 
(Infantry/Reconnaissance 

Breach an Obstacle (Infantry Platoon/Squad) 
Conduct a Defense (Infantry Platoon/Squad) 
Conduct a Link-up 

(Infan try/Mortar/Reconnaissance 

Conduct a Movement to Contact 

(Infantry/Reconnaissance 

Conduct a Raid (Infantry Platoon/Squad) 

Conduct a Screen (Infantry/Reconnaissance 
Platoon/Squad) 

T&EO TASK TITLE 
Conduct a Security Patrol 

(Infantry/Reconnaissance 

Conduct Actions at Danger Areas 

(Infantry/Reconnaissance Platoon) 
Conduct an Infiltration or Exfiltration 
(Infantry/Reconnaissance 

Conduct Convoy Escort (Infantry Platoon/Squad) 
Conduct Operations with Armored or 

Mechanized Vehicles in an Urban 
(Infantry 

Conduct Tactical Movement (Mounted or 
Dismounted) 


(Antiarmor/Infantry/Mortar/Reconnaissance 
Platoon/Squad) 



07-3-1288 

Platoon/Squad) 

07-3-1432 

Platoon/Squad) 

07-3-2000 

Platoon/Squad) 

ARTEP 7-8-MTP 

07-3-1027 

07-3-1054 

07-3-1081 

Platoon/Squad) 



Cross a Water Obstacle (Dismounted) 
(Infantry/Reconnaissance 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Conduct a Route Reconnaissance 
(Infantry/Reconnaissance 

Breach an Obstacle (Infantry Platoon/Squad) 
Conduct a Defense (Infantry Platoon/Squad) 
Conduct a Link-up 

(Infantry/Mortar/Reconnaissance 
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07-3-1090 

Conduct a Movement to Contact 

(Infantry/Reconnaissance 

Platoon/Squad) 



07-3-1126 Conduct a Raid (Infantry 
Platoon/Squad) 


07-3-1144 

Conduct a Screen (Infantry/Reconnaissance 
Platoon/Squad) 


07-3-1153 

Conduct a Security Patrol 

(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1171 

Conduct a Tactical Road March (Dismounted) 
(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1189 

Conduct Actions at Danger Areas 

(Infantry/Reconnaissance Platoon) 


07-3-1216 

Conduct an Infiltration or Exfiltration 
(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1243 

Conduct Operations with Armored or 

Mechanized Vehicles in an Urban 

Environment 


(Infantry 

Platoon/Squad) 


07-3-1270 

Conduct Tactical Movement (Mounted or 
Dismounted) 


(Anti armor/infantry/Mortar/Reconnaissance 
Platoon/Squad) 



07-3-1288 

Platoon/Squad) 

07-3-1432 

Platoon/Squad) 

07-3-2000 

Platoon/Squad) 

ARTEP 7-90-MTP 

07-3-1081 

Platoon/Squad) 

07-3-1270 


07-3-1432 

Platoon/Squad) 

ARTEP 7-91-MTP 

07-2-1036 

ARTEP NUMBER 

T&EO NUMBER 

07-2-1090 


07-2-1279 


07-2-1459 


07-3-1270 


Cross a Water Obstacle (Dismounted) 
(Infantry/Reconnaissance 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Conduct a Route Reconnaissance 
(Infantry/Reconnaissance 

Conduct a Link-up 

(Infan try/Mortar/Reconnaissance 

Conduct Tactical Movement (Mounted or 
Dismounted) 

(Anti armor/infantry/Mortar/Reconnaissance 
Platoon/Squad) 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Conduct a Defense (Antiarmor 
Company/Platoon) 

T&EO TASK TITLE 

Conduct a Movement to Contact 

(Antiarmor/Infantry Company) 

Conduct Convoy Escort (Antiarmor/Infantry 
Company) 

Take Action on Contact (Antiarmor 
Company/Platoon) 

Conduct Tactical Movement (Mounted or 
Dismounted) 

(Anti armor/infantry/Mortar/Reconnaissance 
Platoon/Squad) 
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ARTEP 7-92-MTP 

07-3-1081 

Conduct a Link-up 

(Infantry/Mortar/Reconnaissance 

Platoon/Squad) 


07-3-1090 

Conduct a Movement to Contact 

(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1144 

Conduct a Screen (Infantry/Reconnaissance 
Platoon/Squad) 


07-3-1153 

Conduct a Security Patrol 

(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1171 

Conduct a Tactical Road March (Dismounted) 
(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1189 

Conduct Actions at Danger Areas 

(Infantry/Reconnaissance Platoon) 


07-3-1216 

Conduct an Infiltration or Exfiltration 
(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1270 

Conduct Tactical Movement (Mounted or 
Dismounted) 

(Antiarmor/Infantry/Mortar/Reconnaissance 
Platoon/Squad) 


07-3-1288 

Cross a Water Obstacle (Dismounted) 
(Infantry/Reconnaissance 

Platoon/Squad) 


07-3-1432 

Take Action on Contact 

(Infantry/Mortar/Reconnaissance 

Platoon/Squad) 


07-3-2000 

Conduct a Route Reconnaissance 
(Infantry/Reconnaissance 

Platoon/Squad) 

ARTEP 7-93-MTP 

07-5-1001 

Conduct Surveillance (LRS Team) 


07-5-1002 

Reconnoiter Area (LRS) 


07-5-1003 

Reconnoiter Zone (LRS) 


07-5-1004 

Assess Damage 


07-5-1101 

Conduct Airborne Insertion 


07-5-1102 

Conduct Helicopter Insertion/Extraction 


07-5-1103 

Conduct Ground Infiltration/Exfiltration 


07-5-1107 

Move Tactically (LRS) 


07-5-1108 

Cross Danger Area 


07-5-1109 

Cross Water Obstacle (LRS) 


07-5-1110 

Establish Hide Site 


07-5-1111 

Establish Surveillance Site 


07-5-1112 

Conduct Linkup (LRS Team) 


07-5-1115 

Establish a Patrol Base 


07-5-1201 

Acquire a Target 


07-5-1401 

Evade and Recover 


07-5-1406 

React to Indirect Fire (LRS) 


07-5-1502 

Establish/Recover a Cache 


07-5-1605 

Consolidate and Reorganize (LRS) 
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APPENDIX B—CONSENT EORMS (EXPERIMENT I) 


Naval Postgraduate School 

Participant Consent Form & 

Minimal Risk Statement 

Introduction. You are invited to partieipate in a study entitled Integration of the 
intelligenee cyele and the Infantry Immersion Trainer 

Background: In October 2007, under Marine General James Mattis’ guidance the Marine 
Corps and the Office of Naval Research (ONR) unveiled a $1.3 million prototype 
Infantry Immersion Trainer aboard Camp Pendleton, CA. It was constructed to improve 
Marine Corps combat skills across a wide range of military operations. Some of the tasks 
to conduct the simulation based training involve: 1) Tasks in an urban environment, 2) 
Room clearing, 3) Urban patrolling, and 4) Observation Point (OP) activities. For Marine 
Corps training, this event marked the start of a significant change from traditional field 
training techniques to computer based immersive training. 

The IIT uses digital flats that depict combat images on large wall sized screens; 
the computer generated characters play a role of civilian villagers or insurgent fighters; 
physical artifacts like furnishings, doors and stairwells also add to the realism and can be 
rearranged to fit particular scenarios and alleviate the problem of going through the same 
boring scenario. All of this has been combined with other virtual effects such as 
explosions, loud sounds, smoke, and the horrible smells of combat. The training plan for 
the IIT is to tie the trainer into a constructive play that meets the units training objectives 
for “particular missions, roles and environments.” 

Although much effort has been dedicated on technology to support this training, 
there is still much work to be done with the fundamentals at the Battalion, Company, 
Platoon, Squad, and Fire Team levels. In a real combat environment, intelligence drives 
operations; however, this “train as you fight” concept has not reached fruition in the 
current setup at the IIT; intelligence is minimally factored into the training. This, we 
believe, could and should be appropriately addressed. Following review of the identified 
segments of training that could be improved, we will present training recommendations 
that can fully integrate all phases of the intelligence cycle and will better prepare the 
Marines for mission accomplishment in a combat environment. 

Procedures. You be asked to conduct a walking patrol through an indoor an outdoor 
environment in the vicinity of Halligan Hall and Watkins Hall on the NPS campus. You 
will be given a briefing on the basics of patrolling and methods to gather intelligence 
during a patrol. You will conduct the patrol and gather information and report the critical 
pieces back to the Command and Control Operations Center. You will be asked to walk up 
and down stairs as well as traverse even and uneven surfaces. You be asked to locate items 
you determine as critical information back to the Command and Control Operations Center. 
At the conclusion of the briefing you will conduct a de-brief and complete a short survey. 
You will also be video taped and have still pictures taken during the execution of the patrol. 
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Risks and Benefits. I understand that this experiment does not involve greater than 
minimal risk and involves no known reasonably foreseeable risks or hazards greater than 
those encountered in everyday life. I have also been informed of any benefits to myself 
or to others that may reasonably be expected as a result of this research. 

Compensation. I understand no tangible compensation will be given. I understand that a 
copy of the research results will be available at the conclusion of the experiment. You may 
contact the Principle Investigator (Dr. Amelia Sadagic or Dr. Nita Miller, 
asadagic@nps.edu or nlmiller@nps.edu) for a copy of the results after 1 April 2009. 

Confidentiality & Privacy Act. I understand that all records of this study will be kept 
confidential and that my privacy will be safeguarded. No information will be publicly 
accessible which could identify me as a participant. I will be identified only as a code 
number on all research forms/data bases. My name on any signed document will not be 
paired with my code number in order to protect my identity. I understand that records of 
my participation will be maintained by NPS for three years, after which they will be 
destroyed. 

Voluntary Nature of the Study. Participation in this study is strictly voluntary, and if 
agreement to participation is given, it can be withdrawn at any time without prejudice. 

Points of Contact. I understand that if I have any questions or comments regarding this 
project upon the completion of my participation, I should contact the Principal Investigator, 
Dr. Amelia Sadagic or Dr. Nita Miller, 656-2281, asadagic@nps.edu or nlmiller@nps.edu . 
Any other questions or concerns may be addressed to the Navy Postgraduate School. IRB 
Chair, LCDRPaul O’Connor, 831-656-3864, peoconno@nps.edu. 

Statement of Consent. I have been provided with the purpose, procedures, and duration 
of my participation in this research project and they have been fully explained. I 
understand how my identification will be safeguarded and have had all my questions 
answered. I have been provided a copy of this form for my records and I agree to 
participate in this study. I understand that by agreeing to participate in this research and 
signing this form, I do not waive any of my legal rights. 


Participant’s Signature 


Date 


Researcher’s Signature 


Date 
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Privacy Act Statement and Consent Agreement 
For Audio or Video Recording 


I have received a thorough description of the purpose and procedures for specify audio 
and video recording during the course of the proposed research study. I give my consent 
to allow recording during participation in this study, and for those records to be reviewed 
by persons involved in the study. I understand that all information will be kept 
confidential and will be reported in an anonymous fashion, and that the recordings will be 
erased no later than 60 days from the completion of the study. I further understand that I 
may withdraw this consent at any time without penalty. 


Participant’s Signature 


Date 


Researcher’s Signature 


Date 
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APPENDIX C—IRB REQUEST (EXPERIMENT I) 



Amela Sadagic, Ph.D. 

MOVES Institute 
Nita Lewis Miller, Ph.D. 

Human Systems Integration Program 
Operational Research Department 
Heiko Ahel, Shannon Ayers, and Craig Schwetje 
Glasgow Hall 
Naval Postgraduate School 
Monterey, California 93943 


831-656-2281 
DSN: 756-2281 
Fax: 831-656-9999 
asadagic@nps.edu 

nlniiller@nps.edu 

hahle@nps.edu 

swavers@nps.edu 

crschwet @ nps.edu 


To: Protection of Human Subjects Committee 

Subject: Application for Human Subjects Review (Title): INTEGRATION OF THE 
INTEELIGENCE CYCLE AND THE INFANTRY IMMERSION TRAINER 

Projected Start Date: _FeB / 20_/ 2009_ 

Month Day Year 

I am requesting approval of the attached experimental protocol, it outlines the methods 
and all applicable materials and forms that a participant will read and/or fill-out (i.e., 
consent forms privacy act statements, debriefing forms). 

The Principal Investigator understands and accepts the following 
obligations to protect the rights and welfare of research subjects in this study; 


I recognize that as the Principal Investigator it is my responsibility to ensure that this 
research and the actions of all project personnel involved in conducting this study will 
conform with the IRB approved protocol and IRB requirements/policies. 


I recognize that it is my responsibility to ensure that valid informed consent/assent 
(unless explicitly waived by the IRB) has been obtained from all research subjects or 
their legally authorized representatives. I will ensure that all project personnel involved in 
the process of consent are trained properly and are fully aware of their responsibilities 
relative to obtaining informed consent/assent according to the IRB guidelines. 


I will ensure all personnel involved in this study have completed the required IRB 
Training. 


I will not initiate any change in protocol without IRB approval. 


I have no conflict of interest negating me from performing this research. 
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I will maintain all required researeh reeords on file; and I reeognize that the IRB is 
authorized to inspeet these reeords at any time. 


I will immediately inform the IRB Chair and NFS Dean of Researeh of any untoward 
event or injury that involves a researeh partieipant. 


I understand that in the absenee of a eontinuing review and approval, this research may 
not continue beyond the end of the approval period. 

At the completion of this project, an End-of-Experiment Report will be submitted. 

I will not commence this research, including subject recruitment, until I have received my 
NFS IRB application approval letter. 


(Signature of Frincipal Investigator) 

Dr. Amela Sadagic Dr. Nita Lewis Miller 
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Application for Human Subjects Review NFS IRB Number: _ 

Principal Investigator(s): Dr. Amela Sadagic, Ph.D. MOVES Institute 

Dr. Nita Lewis Miller, Ph.D. 

Co- PI(s) Human Systems Integration Program 

Operational Research Department 


Title of Experiment: INTEGRATION OE THE INTEEEIGENCE CYCEE AND THE 

INEANTRY IMMERSION TRAINER 

Approval Requested [ X ] New [ ] Continuing [ ] Amendment 

Requested Level of Risk [ ] Exempt [X ] Minimal [ ] More than Minimal _ 

Work to be done in (Site/Bldg/Rm) Estimated date of eompletion (not to exceed one year from 
Watkins Hall, Halligan Hall start date): 20 Mar 2009 

Maximum number of participants: Estimated length of each subjects participation: 

24 _ 4 hours (arrival-participate-depart) _ 

Special Populations that will be Used as Participants: 

[ X ] Subordinates [ ] Minors [ X ] NPS Students [ ] Special Needs (e.g. Pregnant women) 

Partieipants will be junior enlisted Marines from the DLL No participant is a direct subordinate to 
any researeher in the study but there is a possibility, although small, a partieipant may be a 
subordinate to a researeher in the future. In order to safeguard information participants will not 
record name, SSN, or any other identifying information on the questionnaire’s or surveys in the 
study. All data collected will be cataloged by a random assignment of a participant number. 
Informed eonsent forms will be kept separate and secure during data analysis so that no attempt 

may be made to match a participant to a partieipant ID. _ 

Scientific Merit Review (Check all that apply) 

[ ] This research is part of a funded project: 

[ X ] This research is a student thesis (Attaeh a eopy of the approved thesis proposal) 

[ ] Other (Attach a complete research proposal-Dept. Chair must sign Application Cover Letter) 
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Outside Cooperating Investigators and Ageneies: 

None. 

Partieipants will be from the Marine detaehment at the Presidio of Monterey, DLL Attaehed is an 
email message from the eommand aeknowledging the request to utilize Marines from the 
eommand. The Marine DLI POC is SSG Smith. 

[X] A eopy of the eooperating institution’s POC and CO’s approval is attaehed. 


Description of Research: 

Overview 

The primary purpose of this Pilot Study is to validate the need for an emphasis on the integration 
of the intelligenee eyele supported by advaneed teehnologieal solutions to more suceessfully train 
and measure the usefulness of their training at the Infantry Immersion Trainer (IIT). To fully 
support this objective, our Pilot Study will provide research data on how to best plan for a location 
and configuration of a Virtual Augmented Combat Operations Center (VA-COC) within 100 meters 
from the IIT for the Marines Operations/Intelligence Briefs and Debriefs. 

The research objectives are to utilize current Battalion-level intelligence capabilities to augment 
the hyper-realistic training offered at the IIT and maximize the training potential that this training 
environment holds. We will investigate relevant performance trends as they are identified in current 
Urban Warfare Training segment in Mojave Viper and make sure those trends are properly 
addressed with training solutions. Design suitable combination of emerging technologies that can 
effectively support desired training objectives. It is planned to research and demonstrate the 
appropriate usage of intelligence capabilities to create a realistic combat experience and determine 
how to evaluate Marine’s situational awareness using both quantitative and qualitative 
measurements. The final objective is to research and analyze the number and the length of training 
sessions required in the IIT to reach the desired level of targeted knowledge and skills. 

Research Methods 

The experiment is set to begin at 09:00 on February 2U* and take one day to complete. There 
will be two group slots, from 09:00 to 12:00 for the first and from 13:00 to 16:00 for the second 
group. We will have one and a half additional days with a total of three backup slots on the 27**^ and 
28* of February. 

We plan to use NPS students and DLI Marines as participants, evaluators and as role-players for 
our Pilot Study. The participants are divided randomly and equally into two groups. Even though 
information about experience levels is collected, we will not control for combat or patrolling 
experience. The two groups are 1) a control group and 2) an experiment group: 

Control Group : Depending on the number of participants, four to five (a fire team) or ten to 
twelve (a squad) participants will be given their Ops/Intel Brief outside the training building in a 
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school-circle. This simulates the current standard at the IIT. A leader will be randomly selected 
from amongst the fire team/squad using a double blind short straw method to lead the planning and 
eonduet of the patrol. The partieipants will be provided with hard eopies of the material available 
and will be afforded the opportunity to ask the briefer any questions for clarification. Following the 
patrol/lane-training, there will be a debrief/After-Aetion Review (AAR) in the same spot as the 
Ops/Intel Brief was given to eapture lessons learned about their aetions from during the exereise. 

Experimental Group : Depending on the number of participants, four to five (a fire team) or ten 
to twelve (a squad) partieipants will be given their Ops/Intel Brief in the VA-COC room, 
simulating the Virtual Augmented Combat Operations Center, loeated within Halligan Hall, from 
where the patrol/lane-training will be eondueted. A leader will be randomly selected using the 
double blind short straw method from amongst the fire team/squad to lead the planning and eonduet 
of the patrol. Information will be displayed graphieally with eurrent visual support teehnology that 
an Infantry Battalion has aeeess to. The participants will be provided with hard eopies of the 
material available and will be afforded the opportunity to ask the briefer any questions for 
elarifieation. Following the patrol/lane-training, their will be a debrief/After-Aetion Review (AAR) 
eondueted in the VA-COC to eapture lessons learned and digitally show the partieipants what they 
did and evaluate their aetions from during the patrol. 

Eaeh group will be given a survey just before the start of the experiment, and just prior and after 
eaeh patrol sequenee. A total of three patrol runs will be done for eaeh team. 

Eaeh squad will be aeeompanied by one or more evaluators. Eaeh evaluator will fill out an 
evaluation form to colleet subjective as well as objeetive information on the squad’s performanee. 
There will be a tape-reeorded question and answers session after the end of the experiment to 
diseover any flaws or misunderstandings the partieipants have with the setup, improve the eurrent 
set-up and use this opportunity to gain more feedback that might not be eaught in the 
questionnaires. 

We expect to have changes in the setup for nearly every single run. This will most eertainly 
affeet the data generated from eaeh run. As improvements in the setup are one of the main purposes 
of a pilot study, we are not mueh eoneerned with loosing power in the analysis of the data. 

Our primary foeus is to validate the proeedure; therefore we do not antieipate to answer the 
hypothesis beyond each group that we are testing and will aecept what appears to be a weak 
response variable. 


Method of Subject Recruitment; (attach an additional sheet if needed). Major Craig Schwetje, 
NFS student and student experimenter, made contact with SSgt Smith of the DEI Marine 
Detachment via phone and email. Major Schwetje described the requirements to SSgt Smith to see 
if the detachment had enlisted Marines to solicit for the experiment. SSgt Smith confirmed the 
detachment had available personnel and a request for volunteers would be announced. Major 
Schwetje verbally provided SSgt Smith with an announcement format to request volunteers. SSgt 
smith read the verbal announcement at the close of business formation in order to announce 
volunteering for participation in the study. SSgt Smith collected a list of names of Marine 
volunteers over a three week period. 
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I have read and understand NPS poliey on the Protection of Human Subjects. If there are any 
changes in any of the above information or any changes to the attached materials, I will suspend the 
experiment until I obtain new IRB approval. 

SIGNATURE DATE 
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APPENDIX D—SURVEY (EXPERIMENT I) 


Please fill in the following questionnaire. All information will be 
held confidential. If you need to expand any answer, please use 
the comments/suggestion section. 

To be filled in upon arrival 

1. Participant Number: _ 

2. Date: February 21,2009 

3. Year of birth: _ Age: _ 

4. Service component: _ 

5. Primary MOS or job specialty (Example-0231 Intelligence Specialist):_ 

6. Rank/Service:_ 

7. Time in service: _years_months 

8. When you think about your own knowledge of infantry tactics, techniques, and procedures, 
how would you rank them? (Please circle one number between 1 and 7 in each line) 


# 

Knowledge and skills: 

Poor 

Your current level 

Excellent 

1. 

Receiving the Ops/Intel Brief 

1 

2 

3 

4 

5 

6 

7 

2. 

Planning for the Patrol 

1 

2 

3 

4 

5 

6 

7 

3. 

Movement of the Patrol 

1 

2 

3 

4 

5 

6 

7 

4. 

Interaction with the locals 

1 

2 

3 

4 

5 

6 

7 

5. 

Finding items of intelligence value 

1 

2 

3 

4 

5 

6 

7 

6. 

Reporting to HHQ during the patrol 

1 

2 

3 

4 

5 

6 

7 

7. 

Sharing/reporting intelligence for future missions 

1 

2 

3 

4 

5 

6 

7 
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*** STOP FILLING THE QUESTIONNAIRE HERE *** 


After the Ops/Intel Brief 

1. Do you understand your mission? 


1 2 

3 4 5 

6 7 

Not at all 

Somewhat 

Yes, clearly 

Explain: 




2. Was the Ops/Intel Brief clearly presented? 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

Explain:_ 

3. What did you most like about how the Ops/Intel Brief was presented? 

Explain:_ 


4. What did you not like about how the Ops/Intel Brief was presented? 
Explain:_ 


5. What do you remember as being the most important item of the Ops/Intel Brief? 


6. What do you have in mind as the most important thing to look for during the patrol? 


7. Who participated in developing the plan of action? Give a score to each person between 0 and 
100, where the four scores add to 100. (A person would be given a score of near 100 only if they 
developed the plan entirely by themselves. The person would be given a score of near 0 if they 
provided minimal or no contribution in plan development). 


148 



The extent to which each person contributed in developing the plan of action: 


Person (code name): 

Score/100: 

Fire team leader 


Gunner 


Rifleman 


Assistant Gunner 


Total Score: 

100 


8. Did you and your team change that plan during the training session that you just finished? 


Y 


N 


a. If YES: 

i) Was that change justified? NO / YES (circle one) 

ii) Was that change well chosen? NO/YES (circle one) 

ill) What was the change consisted of? Describe what was different from your original 
plan: 


9. Think back now about the session that you have just completed. Who did most of the talking? 
Give a score to each person between 0 and 100, where the four scores add to 100. (A person 
would be given a score of near 100 only if they did almost all the talking. They would be given a 
score of near 0 if they did almost no talking). 

The extent to which each person did most of the talking was: 


Person (code name): 

Score/100: 

Fire team leader 


Gunner 


Rifleman 


Assistant Gunner 


Total Score: 

100 


10. Overall, how cooperative was each of the other three people (check one value between 1 
and 7 for each person). 


Person (write the position s/he had) -> 

1^‘ person: 

person: 

3rd person: 

1. Not at all-s/he was not cooperative at all 




2. 




3. 




4. 




5. 




6. 




7. Very much so-s/he was very cooperative. 
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11. Any other comments or suggestions: 


Comments: 


Suggestions: 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 
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After Patrol #1 (Outside Watkins). Please continue filling in the 
questionnaire. 


1. Circle your role in the patrol that you just completed (circle one): 


FiRE TEAM 
LEADER 

GUNNER 

RiFLEMAN 

ASSiSTANT 

GUNNER 


2. Did you simulate loading and making ready your weapon? 


Y 


N 


3. How many threats did you observe during the patrol? 

Personnel_ Vehicle_ 

4. How many threats did you report on during the patrol? 

Personnel_ Vehicle_ 

5. Did you collect any items of intelligence value? 

Yes_ No_ 

If yes, please list and describe:_ 


6. How many threats did you report on after the patrol? 

Personnel_ Vehicle_ 

7. Did you simulate clearing your weapon? 



8. What task was hardest for you? 
It was very hard to:_ 


It was very hard to: 


It was very hard to: 
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It was very hard to: 


9. What task was easiest for you? 
It was very easy to:_ 


It was very easy to: 


It was very easy to: 


It was very easy to: 


10. Rate your confidence in doing the following tasks in the training by checking one block for 
each task (1 means you are NOT confident; 5 means you are HIGHLY confident): 


NOT confident -> HIGHLY confident 



1 

2 

3 

4 

5 

Receiving the Ops/Intel Brief 






Planning for the patrol 






Movement of the Patrol 






Interacting with the locals 






Finding items of intelligence value 






Reporting to HHQ during the patrol 






Sharing/reporting intelligence for future missions 







11. Rate your overall success in executing the mission (1 = NOT successful, 5 = VERY 
successful) 

I was (circle one): NOT successful -> VERY successful 


1 

2 

3 

4 

5 


12. If you think that you were not very successful, what were the reasons for it? 


I was not very successful because: 


I was not very successful because: 
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I was not very successful because:_ 

13. If you think that you were very successful, what were the reasons for it? 

I was very successful because:_ 

I was very successful because:_ 

I was very successful because:_ 

14. Who do you think provided the most valuable reporting? (Circle one): 


FIRE TEAM 

GUNNER 

RIFLEMAN 

ASSISTANT 

LEADER 



GUNNER 


15. Do you have any suggestions for improving your familiarization with the training you just did? 


16. What do you remember as being the most important item of the Situation Update Brief? 


17. What do you have in mind as the most important thing to look for during the 2"'^ patrol? 
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18. Who participated in deveioping the pian of action? Give a score to each person between 0 
and 100, where the four scores add to 100. (A person wouid be given a score of near 100 oniy if 
they deveioped the pian entireiy by themseives. The person would be given a score of near 0 if 
they provided minimal or no contribution in plan development). 

The extent to which each person contributed in developing the plan of action: 


Person (code name): 

Score/100: 

Fire team leader 


Gunner 


Rifleman 


Assistant Gunner 


Total Score: 

100 


19. Did you and your team change that plan during the training session that you just finished? 


Y 


N 


a. If YES: 

iv) Was that change justified? NO / YES (circle one) 

v) Was that change well chosen? NO / YES (circle one) 

vi) What was the change consisted of? Describe what was different from your original 
plan: 


20. Think back now about the session that you have just completed. Who did most of the talking? 
Give a score to each person between 0 and 100, where the four scores add to 100. (A person 
would be given a score of near 100 only if they did almost all the talking. They would be given a 
score of near 0 if they did almost no talking). 

The extent to which each person did most of the talking was: 


Person (code name): 

Score/100: 

Fire team leader 


Gunner 


Rifleman 


Assistant Gunner 


Total Score: 

100 
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21. Overall, how cooperative was each of the other three people (check one value between 1 
and 7 for each person). 


Person (write the position s/he had) ^ 

person: 

2 "° person: 

3rd person: 

1. Not at all-s/he was not cooperative at all 




2. 




3. 




4. 




5. 




6. 




7. Very much so-s/he was very cooperative. 





22. Any other comments or suggestions: 

Comments: _ 


Suggestions: 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 
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APPENDIX E—EVALUATION EORM (EXPERIMENT I) 


Please fill in the following form to the best of your ability. If you need 
to expand on anything, please use the comments/suggestion section. 

Patrol #1 (Outside Watkins). 


Section 0. Admin and Ops/Intel Brief : to be filled BEFORE patrol starts 

1. Patrol Group Number: _ 

2. Date: February 21, 2009 

3. Do the partieipants appear to have a elear understanding of their mission? Please eircle 
one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

Explain:_ 


4. Did the participants simulate loading their weapons? 



Simulated weapon loading 

Fire Team Leader 


Gunner 


Rifleman 


Assistant Gunner 



Section 1. Time : fill in right at the BEGINNING of the patrol 


5. Patrol start time: 
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Section 2 ; to be filled DURING the patrol 


6. Did the participants report to each other someone was observing them? 



Reported (write one strike each 
time you hear it done) 

TOTAL 

Fire Team Leader 



Gunner 



Rifleman 



Assistant Gunner 




7. Did the participants report to HHQ that someone was observing them? 



Reported (write one strike each 
time you hear it done) 

TOTAL 

Fire Team Leader 



Gunner 



Rifleman 



Assistant Gunner 




8. Did the participants locate a weapons cache? 


Y 


N 


a. When/Time? 


b. How many weapons were seized? 

c. Who found it: 
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9. Did the participants find any documents of intelligence value? 


Who found it? -» 

Fire 

Team 

Leader 

Gunner 

Rifleman 

Assistant 

Gunner 

Intelligence found 

Intelligence found #1 





Intelligence found #2 





Intelligence found #3 





Intelligence found #4 





Intelligence found #5 





Intelligence found #6 





Weapon 






a. When did they reach the room (time)? 

10. Did the patrol use their camera? 



Used camera (write one strike each 
time you hear it done) 

TOTAL 

Fire Team Leader 



Gunner 



Rifleman 



Assistant Gunner 




11. On a scale of 1 to 7, how much did the patrol use their note taking material? Please 
circle one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Very much 

12. Any other threat reporting? If so, explain: _ 


13. Do you have any suggestions for improving the training? 
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14. Did the participants simulate clearing their weapons? 



Simulated weapon clearing 

Fire Team Leader 


Gunner 


Rifleman 


Assistant Gunner 



15. Patrol end time: _ 

Section 3 : to be filled AFTER the patrol is completed 

16. Did the participants perform adequately to complete their mission? Please circle one 


number: 

1 2 

3 4 5 

6 7 

Not at all 

Somewhat 

Yes, performance was very adequate 


17. On a scale of 1 to 7, how motivated were the participants during the training? Please 
circle one 

number: 

1 2 3 4 5 6 7 

Not at all Somewhat Very much 

18. On a scale of 1 to 6, how well did the participants act as a team (and not as 
individuals)? 

1 2 3 4 5 6 

Not at all Very well 

19. On a scale of 1 to 6, how often did the team leader request information from the 
team? 

1 2 3 4 5 6 

Not at all Very often 

20. On a scale of 1 to 6, how often did the team members provide information to the 
team leader? 

1 2 3 4 5 6 
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Not at all 


Very often 

21. On a seale of 1 to 6, how strong (directive) was the team leader? 

1 2 3 4 5 6 

Not at all Very strong 

22. On a scale of 1 to 6, how often was the authority of the team leader questioned? 

1 2 3 4 5 6 

Not at all Very often 

23. On a scale of 1 to 6, how much trust did the team leader have in the team member’s 

performance and reports? 

1 2 3 4 5 6 

Not trust at all Very much trust 

24. On a scale of 1 to 6, how often did the team wait for decisions of the team leader? 

1 2 3 4 5 6 

Not at all Very often 

25. On a scale of 1 to 6, how often did the team have arguments on patrolling strategies? 

1 2 3 4 5 6 

Not at all Very often 

26. On a scale of 1 to 6, how well did the team members adopt their individual roles in 

the team? 

1 2 3 4 5 6 

Not at all Very well 

27. Besides the official team leader, did an informal leader emerge? 



Section 4. Final Comments; 

28. Any other comments or suggestions: 
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Comments: 


Suggestions: 


*** END of PATROL #1 EVALUATION *** 
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APPENDIX F—PILOT STUDY SCHEDULE (EXPERIMENT I) 


Master timeline sheet for pilot study 


Action _ Time _ Responsible 


1. Participants for 
control group arrive 

2. Assign random IDs, 
form patrols, choose fire 
team leaders. 

3. Patrolling class for 
all 3 groups 

4. Intel training for 
fire teams 

5. Rehearsals for all 

6. Patrol 1 for Fire team 1 

7. Patrol 1 for Fire team 2 

8. Patrol 1 for Fire team 3 

9. Debrief of Fire team 1 

10. Debrief of Fire team 2 

11. Patrol 2 for Fire team 1 
(offer water) 

12. Debrief of Fire team 3 

13. Patrol 2 for Fire team 2 
(offer water) 

14. Patrol 2 for Fire team 3 
(offer water) 

15. Debrief of Fire team 1 

16. Debrief of Fire team 2 

17. Patrol 3 for Fire team 1 

18. Debrief of Fire team 3 

19. Patrol 3 for Fire team 2 

20. Patrol 3 for Fire team 3 


0800 

Experimenters 1, 

0800-0830 

Experimenter 1 

0830-0845 

Experimenter 1 

0845-0855 

Experimenter3 

0900-0930 

Experimenters 1, 

0940-1000 

Experimenter3 

0955-1015 

Experimenter3 

1000-1020 

Experimenter3 

1005-1010 

Experimenter3 

1010-1015 

Experimenter3 

1015-1035 

Experimenter2 

1020-1025 

Experimenter3 

1025-1045 

Experimenter2 

1035-1055 

Experimenter2 

1040-1045 

Experimenter2 

1045-1050 

Experimenter2 

1050-1110 

Experimenter 1 

1055-1100 

Experimenter2 

1100-1120 

Experimenter 1 

1110-1130 

Experimenter 1 


Resources 

(offer doughnuts) 
2,3 

all three 
2,3 
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21. Debrief of Fire team 1 

22. Debrief of Fire team 2 

23. Debrief of Fire team 3 

24. After Aetion Review 
Debrief 

25. Luneh 

26. Partieipants for 
group arrive 

27. Assign random IDs, 
patrols, ehoose fire 
leaders. 

28. Patrolling elass for 
3 groups 

29. Intel training 
for all 3 groups 

30. Rehearsals for all 

31. Patrol 1 for Fire team 1 

32. Patrol 1 for Fire team 2 

33. Patrol 1 for Fire team 3 

34. Debrief of Fire team 1 

35. Debrief of Fire team 2 

36. Patrol 2 for Fire team 1 

37. Debrief of Fire team 3 

38. Patrol 2 for Fire team 2 

39. Patrol 2 for Fire team 3 

40. Debrief of Fire team 1 

41. Debrief of Fire team 2 

42. Patrol 3 for Fire team 1 

43. Debrief of Fire team 3 

44. Patrol 3 for Fire team 2 

45. Patrol 3 for Fire team 3 

46. Debrief of Fire team 1 

47. Debrief of Fire team 2 

48. Debrief of Fire team 3 


1115-1120 

Experimenter 1 


1120-1125 

Experimenter 1 


1125-1130 

Experimenter 1 


1130-1155 

All Hands 

and 

1200-1230 

All Hands 

Pizza & Soda 

1300 

Experimenters 1, 2, 3 

treatment 

1300-1330 

Experimenter 1 

form 

team 

1330-1345 

Experimenter3 

all 

1345-1355 

Experimenter 1 


1400-1430 

Experimenters 1, 2, 3 


1440-1500 

Experimenter3 


1455-1515 

Experimenter3 


1500-1520 

Experimenter3 


1505-1510 

Experimenter3 


1510-1515 

Experimenter3 


1515-1535 

Experimenter2 

(offer water) 

1520-1525 

Experimenter3 


1525-1545 

Experimenter2 

(offer water) 

1535-1555 

Experimenter2 

(offer water) 

1540-1545 

Experimenter2 


1545-1550 

Experimenter2 


1550-1610 

Experimenter 1 


1555-1600 

Experimenter2 


1600-1620 

Experimenter 1 


1610-1630 

Experimenter 1 


1615-1620 

Experimenter 1 


1620-1625 

Experimenter 1 


1625-1630 

Experimenter 1 
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49. After Action Review 
Debrief 

50. After experiment cleanup 


1630-1655 All Hands 
1700-1730 All Hands 


and 

water 




Table 1. Master timeline sheet for pilot study. 
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APPENDIX G—PILOT STUDY SCENARIOS (EXPERIMENT I) 


ORIENTATION BRIEF FOR ECONOMY OF FORCE OPERATIONS IN THE 

TOWN OF NPS 


GENERAL SITUATION : 

Battalion, E* Marines has recently conducted a Relief in Place (RIP) with 3/509*’’ INF 
BDE (-), US ARMY in the Babil Province. RCT I, has tasked 3/1 to conduct Economy of 
Force Operations in the Babil Province as 2“’’ Battalion, 4*’’ Marines (the remaining 
Battalion responsible for COIN/Security Operations in the Babil Province) has been 
directed to conduct a clearance in zone operation with ARMY CF in the Diyala Province. 

As part of the Battalion’s Economy of Force Operations, Companies have been tasked to 
conduct Active Reconnaissance in several villages on the Northern border of the Babil 
Province and prevent the infiltration and extraction of A1 Qaeda forces from the Diyala 
Province. Your Company has been tasked to establish a Combat Outpost (COP) near the 
town of NPS, conduct an active reconnaissance of the area, and prevent/disrupt the flow 
of A1 Qaeda forces into Diyala Province. No Coalition Forces have been active in the 
town of NPS for approximately 6 months, however, intelligence provided by RCT-1, 
compiled from multiple SIGINT and HUMINT assets, members of A1 Sawah and 
Predator UAVs have identified that the town is being utilized as a crossing point for A1 
Qaeda forces desiring to cause instability in the Diyala Province. Three weeks ago, the 
local religious leader of NPS visited COP Snake in the Diyala Province and offered his 
willingness to work with CF. This information was turned over to RCT 1, whose Area of 
Operations includes the town of NPS in the Babil Province. The local religious leader has 
not been heard from since. 


ORIENTATION : 

Your boundaries are the walls of Watkins Hall. LZ Bullrush and LZ Condor have been 
established on the SE and NW corners of Watkins Hall. You are operating in an urban 
environment with no vegetation. 


Mission . NET XXX conduct an urban patrol outside the perimeter of Watkins Hall 
and search for enemy presence and lines of communication of possible enemy forces 
operating in the area. 

NOTE: Main things that are being looked at are their movement in an Urban Area, 
reaction to an observer along the patrol route, and Intel collection activities. 


TASK ORGANIZATION: 
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Squad Leaders will ensure the following are designated: 

1 EPW/Detainee Team 

2. AID/Litter Team 

3. SSL Team 

4. Other as direeted by your Company Headquarters 

COORDINATING INSTRUCTIONS : 

Squad Leaders will ensure the following are briefed prior to departing: 

1. No COMM Plan 

2. Lost Marine Plan 

3. Signal Plan 

4. lAD to lED Unexploded 

5.1 AD to lED Exploded 
6. lAD to Sniper Contaet 

7.1 AD to SAE Ambush 

8. CASEVAC Plan 

9. Squad Eeaders to ensure Marines have their T/E gear to inelude NATO 9-Eine 
MEDEVAC Request, lED/UXO Report, and EZ Brief 

ADMINISTRATION AND EOGISTICS : 

A. Administration 

1. Casualties: Air MEDEVACs, Utilize the NATO 9-Eine Report Eormat, 

eherry pieker 

2. EPWs: Move them to a designated eonsolidation point, pieked up by 

QRE. 
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SITUATION UPDATE #I 


GENERAL SITUATION : 

The enemy in the area has moved their operations into the building of Watkins. 


ORIENTATION : 

Your boundaries are the E* floor of Watkins Hall. You are operating in an urban 
environment with no vegetation. 


Mission . NUT XXX conduct an urban patrol through the I** floor of Watkins Hall 
and search for weapons and other enemy related material lOT disrupt enemy 
activities operating in the area. 

NOTE: Main things that are being looked at are their movement in an Urban Area 
and Intel collection activities. 


TASK ORGANIZATION : 

Eire Team Leaders will ensure the following are designated: 

1 EPW/Detainee Team 

2. AID/Litter Team 

3. SSL Team 

4. Other as direeted by your Company Headquarters 

COORDINATING INSTRUCTIONS : 

Eire Team Leaders will ensure the following are briefed prior to departing: 

1. No COMM Plan 

2. Lost Marine Plan 

3. Signal Plan 

4. lAD to lED Unexploded 

5.1 AD to lED Exploded 
6. lAD to Sniper Contaet 

7.1 AD to SAE Ambush 
8. CASEVAC Plan 
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9. Squad Leaders to ensure Marines have their T/E gear to include NATO 9-Line 
MEDEVAC Request, lED/UXO Report, and EZ Brief 

ADMINISTRATION AND EOGISTICS : 

A. Administration 

1. Casualties: Air MEDEVACs, Utilize the NATO 9-Eine Report Eormat, 

cherry picker 

2. EPWs: Move them to a designated consolidation point, picked up by 

QRE. 
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SITUATION UPDATE #2 


GENERAL SITUATION : 
No change. 


ORIENTATION : 

Your boundaries are the 2"*^ floor of Watkins Hall. You are operating in an urban 
environment with no vegetation. 


Mission . NUT XXX conduct an urban patrol through the 2"^* floor of Watkins Hall 
and link-up with Chief Heiko lOT determine the status of the local religious leader 
(mentioned in the orientation brief) as well as the status of the local populace and 
enemy forces operating in the area. 

NOTE: The participants will get an Intel dump from the Chief based upon how they 
interact with the Chief. If they don’t try to get information, he gives them nothing; if 
they do a standard job, try to Cordon and Search in our designated room and play 
the Culture game, he will give the Marines some ambiguous information for them to 
report at the Debrief, requesting in return, items to improve the village's 
infrastructure and help stabilize the city. Main things that are being looked at are 
their movement in an Urban Area and Intel collection activities. 


TASK ORGANIZATION : 

Squad Leaders will ensure the following are designated: 

1 EPW/Detainee Team 

2. AID/Litter Team 

3. SSE Team 

4. Other as direeted by your Company Headquarters 

COORDINATING INSTRUCTIONS : 

Squad Leaders will ensure the following are briefed prior to departing: 

1. No COMM Plan 

2. Lost Marine Plan 

3. Signal Plan 

4. lAD to lED Unexploded 
5.1 AD to lED Exploded 
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6. lAD to Sniper Contact 
7.1 AD to SAP Ambush 

8. CASEVAC Plan 

9. Squad Leaders to ensure Marines have their T/E gear to include NATO 9-Line 
MEDEVAC Request, lED/UXO Report, and LZ Brief 

ADMINISTRATION AND LOGISTICS : 

A. Administration 

1. Casualties: Air MEDEVACs, Utilize the NATO 9-Line Report Eormat, 

cherry picker 

2. EPWs: Move them to a designated consolidation point, picked up by 

QRE. 
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APPENDIX H—CONSENT EORMS (EXPERIMENT 2) 


Naval Postgraduate School 

Participant Consent Form & 

Minimal Risk Statement 

Introduction. You are invited to partieipate in a study entitled INTEGRATING 
INTELLIGENCE ACTIVITIES AND BUILDING TEAMS WITH THE INFANTRY 
IMMERSION TRAINER 


Background: In October 2007, under Marine General James Mattis’ guidance the 
Marine Corps and the Office of Naval Research (ONR) unveiled a prototype Infantry 
Immersion Trainer—IIT aboard Camp Pendleton, CA. It was constructed to improve 
Marine Corps combat skills across a wide range of military operations. Some of the tasks 
to conduct the simulation based training involve; 1) Tasks in an urban environment, 2) 
Room clearing, 3) Urban patrolling, and 4) Observation Point (OP) activities. 

The study that you will participate in is looking into different ways in which the training 
in IIT facility could be improved even further. 

Procedures. You will be asked to conduct a walking patrol through an indoor an outdoor 
environment in the vicinity of the Infantry Immersion Trainer at Camp Pendleton, CA. 
You will be asked to walk along even and uneven surfaees. Prior to your partieipation 
you will be asked to fill in a short survey. You will then be asked to eomplete a set of 
tasks in several different scenarios; at the end of each scenario you will be asked to 
complete a short survey, after which an After Action Review (AAR) with entire team will 
be conducted. You will be videotaped and have still pietures taken during the execution 
of the patrol and AAR. 

Risks and Benefits. I understand that this experiment does not involve greater than 
minimal risk and involves no known reasonably foreseeable risks or hazards greater than 
those encountered in everyday life. I have also been informed of any benefits to myself 
or to others that may reasonably be expected as a result of this research. 

Compensation. I understand no tangible compensation will be given. I understand that 
a copy of the research results will be available at the eonclusion of the experiment. You 
may eontact the Prineiple Investigator (Dr. Amela Sadagie asadagic@nps.edu) for a copy 
of the results after 25 September 2009. 

Confidentiality & Privacy Act. I understand that all records of this study will be kept 
confidential and that my privacy will be safeguarded. No information will be publicly 
accessible which could identify me as a participant. I will be identified only as a code 
number on all research forms/data bases. My name on any signed document will not be 
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paired with my code number in order to protect my identity. I understand that records of 
my participation will be maintained by NPS for three years, after which they will be 
destroyed. 

Voluntary Nature of the Study. Participation in this study is strictly voluntary, and if 
agreement to participation is given, it can be withdrawn at any time without prejudice. 

Points of Contact. I understand that if I have any questions or comments regarding this 
project upon the completion of my participation, I should contact the Principal 
Investigator, Dr. Amela Sadagic, 656-3819, asadagic@nps.edu . Any other questions or 
concerns may be addressed to the Naval Postgraduate School. IRB Chair, LCDR Paul 
O’Connor, 831-656-3864, peoconno@nps.edu . 

Statement of Consent. I have been provided with the purpose, procedures, and duration 
of my participation in this research project and they have been fully explained. I 
understand how my identification will be safeguarded and have had all my questions 
answered. I have been provided a copy of this form for my records and I agree to 
participate in this study. I understand that by agreeing to participate in this research and 
signing this form, I do not waive any of my legal rights. 


Participant’s Signature 


Date 


Researcher’s Signature 


Date 
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Privacy act Statement and Consent Agreement 
for Audio or Video Recording 


I have received a thorough description of the purpose and procedures for specify audio 
and video recording during the course of the proposed research study. I give my consent 
to allow recording during participation in this study, and for those records to be reviewed 
by persons involved in the study. I understand that all information will be kept 
confidential and will be reported in an anonymous fashion, and that the recordings will be 
erased no later than 60 days from the completion of the study. I further understand that I 
may withdraw this consent at any time without penalty. 


Participant’s Signature 


Date 


Researcher’s Signature 


Date 
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APPENDIX I—IRB REQUEST (EXPERIMENT 2) 



Amela Sadagic, Ph.D. 
MOVES Institute 
Craig Schwetje 
Watkins Hall 

Naval Postgraduate School 
Monterey, California 93943 


831-656-3819 
DSN: 756-2281 
Fax: 831-656-9999 
asadagic@nps.edu 

crschwet@nps.edu 


To: Protection of Human Subjects Committee 

Subject: Application for Human Subjects Review (Title): INTEGRATING 
INTELLIGENCE ACTIVITIES AND BUILDING TEAMS WITH THE INEANTRY 
IMMERSION TRAINER 

Projected Start Date: _ APRIL / 27_/ 2009_ 

Month Day Year 

I am requesting approval of the attached experimental protocol, it outlines the methods 
and all applicable materials and forms that a participant will read and/or fill-out (i.e., 
consent forms privacy act statements, debriefing forms). 

The Principal Investigator understands and accepts the following 
ohligations to protect the rights and welfare of research subjects in this study; 


I recognize that as the Principal Investigator it is my responsibility to ensure that this 
research and the actions of all project personnel involved in conducting this study will 
conform with the IRB approved protocol and IRB requirements/policies. 


I recognize that it is my responsibility to ensure that valid informed consent/assent 
(unless explicitly waived by the IRB) has been obtained from all research subjects or 
their legally authorized representatives. I will ensure that all project personnel involved in 
the process of consent are trained properly and are fully aware of their responsibilities 
relative to obtaining informed consent/assent according to the IRB guidelines. 


I will ensure all personnel involved in this study have completed the required IRB 
Training. 


I will not initiate any change in protocol without IRB approval. 


I have no conflict of interest negating me from performing this research. 
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I will maintain all required researeh reeords on file; and I reeognize that the IRB is 
authorized to inspeet these reeords at any time. 


I will immediately inform the IRB Chair and NFS Dean of Researeh of any untoward 
event or injury that involves a researeh partieipant. 


I understand that in the absenee of a eontinuing review and approval, this researeh may 
not eontinue beyond the end of the approval period. 

At the eompletion of this projeet, an End-of-Experiment Report will be submitted. 

I will not eommenee this researeh, including subject recruitment, until I have received my 
NFS IRB application approval letter. 


(Signature of Frincipal Investigator) 


Dr. Amela Sadagic 
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Application for Human Subjects Review NFS IRB Number: 


Principal Investigator(s): 
Co- PI(s) 


Dr. Amela Sadagic, Ph.D., MOVES Institute 
Major Craig Schwetje, MOVES Institute 


Title of Experiment: 


INTEGRATING INTEEEIGENCE ACTIVITIES AND BUIEDING 
TEAMS WITH THE INFANTRY IMMERSION TRAINER 


Approval Requested 


[ X ] New 


[ ] Continuing [ ] Amendment 


Requested Eevel of Risk [ ] Exem] 

Dt [X ] Minimal [ ] More than Minimal 

Work to be done in (Site/Bldg/Rm) 
Camp Pendleton, CA/Infantry 
Immersion Trainer 

Estimated date of eompletion (not to exceed one year from 
start date): 1 August 2009 

Maximum number of partieipants: 
150 

Estimated length of eaeh subjeets partieipation: 

8 hours (arrival-partieipation-departure) 


Special Populations that will be Used as Partieipants: 


[ X ] Subordinates [ ] Minors [ ] NPS Students [ ] Speeial Needs (e.g. Pregnant women) 

Partieipants will be junior enlisted Marines from U* Radio Battalion and Eeho Company, 2d 
Battalion, 4* MAR. No participant is a direct subordinate to any researeher in the study but there is 
a possibility, although small, a partieipant may be a subordinate to the researeher in the future. In 
order to safeguard information partieipants will not reeord name, SSN, or any other identifying 
information on the questionnaire’s or surveys in the study. All data eollected will be eataloged by a 
random assignment of a partieipant number. Informed eonsent forms will be kept separate and 
secure during data analysis so that no attempt may be made to mateh a partieipant to a partieipant 

ID. _ 

Seientifie Merit Review (Check all that apply) 

[ ] This research is part of a funded projeet: 

[ X ] This research is a student thesis (Attaeh a copy of the approved thesis proposal) 

[ ] Other (Attaeh a eomplete researeh proposal-Dept. Chair must sign Applieation Cover Fetter) 

Outside Cooperating Investigators and Ageneies: None. 

Partieipants will be from U* Radio Battalion (RADBN) and Eeho Company, 2d Battalion, 4**^ MAR 
(E/2/4) at Camp Pendleton, CA. Attaehed is an email message from the eommand aeknowledging 
the request to utilize Marines from the eommand. The POCs for RADBN are SSgt Stokes, 
Christian or GySgt Carter, Samuel at 763-5986/4361. POC for E/2/4 is 1st Et Borden, Jerome at 
763-0816. 

[X] A eopy of the cooperating institution’s POC and CO’s approval is attaehed. 
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Description of Research: 

Overview 

The primary purpose of this study is to validate the need for an emphasis on the skill integration 
in support of advanced technological solutions with the goal of more successfully training. A case 
study that will be used in this in this effort is integration of the full intelligence cycle, and a 
specific training facility that study will focus on is the Infantry Immersion Trainer (IIT) located in 
Camp Pendleton. To fully support this objective, the study will provide research data on how to de- 
emphasize technology-centered approach, and emphasize skill integration approach (training- 
centered approach). This will be achieved by introducing a Squad Planning Operations Center 
(SPOC) configuration planned to be within 100 meters from the IIT for the Marines Patrol Briefs 
and Debriefs, designed specifically to support skill integration and full intelligence cycle. The 
design of SPOC also includes a design of a set of resources to be used for unit’s work and briefings. 

We plan to utilize current Battalion-level intelligence capabilities to augment the hyper-realistic 
training offered at the IIT and maximize the training potential that this training environment holds. 
We will investigate relevant performance trends as they are identified in current Urban Warfare 
Training segment in Mojave Viper and make sure those trends are properly addressed with training 
solutions. We will also design a suitable combination of emerging technologies that can effectively 
support desired training objectives. It is planned to (1) research and demonstrate the appropriate 
usage of intelligence capabilities to create a realistic combat experience, and (2) to determine how 
effective two alternative approaches were in Marines’ training by using both quantitative and 
qualitative measurements collected in the study. 

Research Methods 

The experiment is set to begin at in April 2009 and will take two weeks to complete. There will 
be two units training at the IIT (RADBN and E/2/4), each for a one week period. 

We plan to use the Marines from these two units as participants. The evaluators and role-players 
will be provided by the personnel permanently assigned to work at the IIT. The scenarios utilized 
during this training will be drafted by the IIT staff to meet the training units training requirements. 
The participants will be divided randomly and equally into two groups. Even though information 
about experience levels is collected, we will not control for combat or patrolling experience. The 
two groups are 1) a control group and 2) an experimental group: 

Control Group : Depending on the number of participants, twelve to thirteen (a squad size 
element) participants will be given their Patrol Brief outside the IIT in a school-circle just like what 
is normally done at the IIT during their training. This is the current standard at the IIT. Eollowing 
the patrol, there will be a debrief/After-Action Review (AAR) in the same spot as the Patrol Brief 
was given to capture lessons learned about their actions from during the exercise. This is the 
current standard at the IIT. 

Experimental Group : Depending on the number of participants, twelve to thirteen (a squad size 
element) participants will be given their Patrol Brief in the SPOC, located within 100 meters from 
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the IIT. Briefing information will be displayed graphieally with eurrent visual support teehnology 
that an Infantry Battalion has aeeess to. The partieipants will be provided with hard eopies of the 
material available and will be afforded the opportunity to ask the briefer any questions for 
elarifieation. Following the patrol, their will be a debrief/After-Action Review (AAR) eonducted in 
the SPOC. The purpose of the debrief/AAR will be to eapture lessons learned, reinforee the skill 
set that is expeeted to be perfeeted during the training sessions, illustrate the results that Marines 
aehieved, and provide eonstruetive eritique and guidanee for follow-up sessions. 

Eaeh group will be given a survey just before the start of the experiment, and just prior and after 
eaeh patrol sequenee. A total of five patrol runs will be done for eaeh team. Both eontrol and 
experimental groups will go through the same set of seenarios. 

Eaeh squad will be aeeompanied by one or more evaluators. Eaeh evaluator will fill out an 
evaluation form to eolleet both qualitative and quantitative information on the squad’s performanee. 
There will be a tape-reeorded question and answers session after the end of the experiment to 
elarify any potential misunderstandings (Note: questionnaire forms will be administered prior to the 
team briefing and team diseussion). We will use this opportunity to gain more feedbaek that might 
not be eaught in the questionnaires. 

Method of Subject Recruitment: Major Craig Sehwetje, USMC (NPS student) made initial 
eontact with Tom Buscemi (Direetor, I MEE Battle Simulation Center, Camp Pendleton) over a 
year ago. The two have been in eontaet frequently sinee that time via phone, email, and in person 
at the IIT. Major Sehwetje has deseribed the requirements to Mr. Buscemi. Mr. Buscemi then 
provided the training schedule to coordinate with the two units mentioned earlier (i.e., RADBN and 
E/2/4) to see if these units could support the experiment. 


I have read and understand NPS policy on the Protection of Human Subjects. If there are any 
changes in any of the above information or any changes to the attached materials, I will suspend the 
experiment until I obtain new IRB approval. 

SIGNATURE DATE 
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APPENDIX J—SURVEY (EXPERIMENT 2) 


Please fill in the following questionnaire. All information will be held 
confidential. If you need to expand any answer, please use the 
comments/suggestion section. 

To be filled in upon arrival 


1. Participant unit and squad number:_ 

2. Date: April 27 - May 8, 2009 

3. Year of birth: _ Age: _ 

4. Billet: ___ 

5. Primary MOS or job specialty (Example-0231 Intelligenee Specialist):_ 

6. Rank/Service:_ 

7. Time in service: _years_months 

8. When you think about your own knowledge of infantry tactics, techniques, and 
proeedures, how would you rank them? (Please eircle one number between 1 and 7 in 
eaeh line) 


# 

Knowledge and skills: 

Poor 


Your current level 

Excellent 

8. 

Receiving the Brief 

1 

2 

3 

4 

5 

6 

7 

9. 

Planning for the Patrol 

1 

2 

3 

4 

5 

6 

7 

10 

Movement of the Patrol 

1 

2 

3 

4 

5 

6 

7 

11 

Interaction with the locals 

1 

2 

3 

4 

5 

6 

7 

12 

Finding items of intelligence value 

1 

2 

3 

4 

5 

6 

7 

13 

Reporting to HHQ during the patrol 

1 

2 

3 

4 

5 

6 

7 

14 

Sharing/reporting intelligence for future missions 

1 

2 

3 

4 

5 

6 

7 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 
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After Brief #1. 

1. Do you understand your mission? Please eirele one number that refleets your opinion. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, elearly 

Explain:_ 

2. Was the Brief elearly presented? Please eirele one number that refleets your opinion. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, elearly 

Explain:__ 

3. What did you most like about how the Brief was presented? 

Explain:_ 


4. What did you not like about how the Brief was presented? 
Explain:_ 


5. What do you remember as being the most important item of the Brief? 


6. What do you have in mind as the most important thing to look for during the patrol? 


7. Any other eomments or suggestions: 

Comments: 


Suggestions: 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 
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After Patrol #1. 


1. Circle your role in the patrol that you just eompleted (eirele one): 


SQUAD 

MEMBER 

MEMBER 

MEMBER 

LEADER 

FIRE TEAM 1 

FIRE TEAM 2 

FIRE TEAM 3 


2. Did you load and make ready your weapon before departing on the patrol? 



3. How many threats did you observe during the patrol? 

Personnel_ Vehiele_ 

4. How many threats did you report on during the patrol? 

Personnel_ Vehiele_ 

5. Did you eolleet any items of intelligenee value? 

Yes_ No_ 

If yes, please list and deseribe:_ 


6. How many threats did you report on after the patrol? 

Personnel_ Vehiele_ 

7. Did you elear your weapon upon return to friendly lines? 



8. What task was hardest for you? 

It was very hard to:_ 
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It was very hard to; 


It was very hard to; 


It was very hard to; 


9. What task was easiest for you? 
It was very easy to;_ 


It was very easy to; 


It was very easy to; 


It was very easy to; 


10. Rate your eonfidenee in doing the following tasks in the training by eheeking one 
bloek for each task (1 means you are NOT confident; 7 means you are HIGHLY 
confident). Please circle one number that reflects your opinion. 


NOT confident Hi 

[GHLY confic 

lent 


1 

2 

3 

4 

5 

6 

7 

Receiving the Brief 








Planning for the patrol 








Movement of the patrol 








Interacting with the locals 








Finding items of intelligence value 








Reporting to HHQ during the patrol 








Sharing/reporting intelligence for future 
missions 
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11. Rate your overall sueeess in executing the mission (1 = NOT successful, 7 = VERY 
successful). Please circle one number that reflects your opinion. 

I was (circle one): N OT successful __ VERY successfu 

1 I2I3I4I5I6I7 

12. If you think that you were not very successful, what were the reasons for it? 

I was not very successful because:_ 

I was not very successful because:_ 

I was not very successful because:_ 

13. If you think that you were very successful, what were the reasons for it? 

I was very successful because:_ 

I was very successful because:_ 

I was very successful because:_ 

14. Who do you think provided the most valuable reporting? (circle one): 


SQUAD 

MEMBER 

MEMBER 

MEMBER 

LEADER 

FIRE TEAM 1 

FIRE TEAM 2 

FIRE TEAM 3 
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15. Do you have any suggestions for improving your familiarization with the training 
you just did? 


16. What do you remember as being the most important item of the Brief? 


17. What do you have in mind as the most important thing to look for during the next 
patrol? 


18. The following questions (a through g), deal with the virtual people displayed on the 
wall. Please answer if applieable. On a seale of 1 to 7, please cirele a number for the 
following statements: 


a. I pereeived that I was in the presenee of real people when the people displayed 
on the wall were in the room. 


1 2 3 4 5 6 7 


Not at all Somewhat 


Yes, elearly 


b. I felt that the people displayed on the wall were watehing me. 


1 2 3 4 5 6 7 


Not at all Somewhat 


Yes, elearly 
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c. The thought that the people displayed on the wall are not real people erossed 
my mind often. 

1 2 3 4 5 6 7 

Not at all Somewhat Very often 

d. I looked at the people displayed on the wall often. 

1 2 3 4 5 6 7 

Not at all Somewhat Very often 

e. The people displayed on the wall appeared to be real to me. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

f I perceived the people displayed on the wall as only computerized images, not 

people. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

g. I believed that the people displayed on the wall represented real people. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

19. Any other comments or suggestions: 

Comments: 


Suggestions: 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 
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xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


The remaining questions are to only be answered following your final patrol. 


xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


19. Based on your military experiences, on a scale of 1 to 7, please circle a number in 
each of the following statements: 


a. This training was an effective way to train me how to patrol in an urban 
environment. 


1 2 3 4 5 6 7 


Not at all Somewhat 


Yes, clearly 


b. This training was an effective way to train me how to patrol in an urban 
environment versus other urban environment training that I have done in the past. 
(Please either circle N/A or a number between 1 and 7). 

1 2 3 4 5 6 7 N/A 

Not at all Somewhat Yes, clearly Not Applicable 

c. Having experienced actual urban environment patrolling, this training was an 
effective way to train me how to patrol in an urban environment. (Please either 
circle N/A or a number between 1 and 7). 

1 2 3 4 5 6 7 N/A 

Not at all Somewhat Yes, clearly Not Applicable 

20. This training improved my urban patrolling skills. 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 


21. This training improved my information gathering skills. 


1 2 3 4 5 6 7 


Not at all Somewhat 


Yes, clearly 
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22. Any other comments or suggestions: 


Comments: 


Suggestions: 


*** STOP FILLING THE QUESTIONNAIRE HERE *** 

Thank you for volunteering to participate in this study. 
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APPENDIX K—EVALUATION EORM (EXPERIMENT 2) 


Please fill in the following form to the best of your ability. If you need 
to expand on anything, please use the comments/suggestion section. 

Patrol #1. 


Section 1. Admin and Brief for Patrol #1 ; to be filled BEFORE patrol starts 


1. Unit/Squad Number:_ 

2. Date: April 27 - May 8, 2009 

3. Do the partieipants appear to have a clear understanding of their mission? Please circle 
one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

Explain:__ 


4. Did all the participants load their weapons? Please circle ‘YES’ or ‘NO’: 


YES 


NO 


5. Did the squad leader load his weapon? 


YES 


NO 


6. If someone did not load his weapon, how many in each billet did not do it? (Else tick 
marks or just write in a total): 



Simulated weapon loading 

Eire Team Eeader 


Gunner 


Rifleman 


Assistant Gunner 
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Area for notes: 


*** DONE UNTIL AFTER THE PATROL *** 
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Section 2. Patrol #1 ; to be filled AFTER the patrol 


1. Did the participants report to each other someone was observing them? Please circle 
one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

Explain:_ 

2. Did the participants report to HHQ that someone was observing them? Please circle 
one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Yes, clearly 

Explain:_ 

3. Did the participants locate a weapons cache? Please circle ‘YES’ or ‘NO’: 


YES 


NO 


b. How many weapons were seized? 

c. Who found it: 


4. Was there supposed to be a weapons cache for this scenario? Please circle ‘YES’ or 


‘NO’: 


YES 


NO 


5. Did the participants find any documents of intelligence value? Please circle ‘YES’ or 
‘NO’: 


YES 


NO 


b. How many documents were found? 

c. Who found them: _ 


6. Was there supposed to be documents of intelligence value for this scenario? Please 
circle ‘YES’ or ‘NO’: 


YES 


NO 
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Area for notes: 




7. Did the patrol use their camera? Please circle ‘YES’ or ‘NO’: 


YES 


NO 


8. On a scale of 1 to 7, how much did the patrol use their note taking material? Please 
circle one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Very much 


9. Do you have any suggestions for improving the training? 


10. Did the participants clear their weapons? Please circle ‘YES’ or ‘NO’: 


YES 


NO 


11. Did the squad leader clear his weapon? Please circle ‘YES’ or ‘NO’: 
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YES 


NO 


12. If someone did not load his weapon, how many in eaeh billet did not do it? (Use tiek 
marks or just write in a total): 



Simulated weapon loading 

Fire Team Leader 


Gunner 


Rifleman 


Assistant Gunner 





Area for notes: 




13. Did the participants perform adequately to complete their mission? Please circle one 
number: 


1 2 3 4 5 6 7 

Not at all Somewhat Yes, performance was very adequate 

14. On a scale of 1 to 7, how motivated were the participants during the training? Please 
circle one number: 

1 2 3 4 5 6 7 

Not at all Somewhat Very much 
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15. On a scale of 1 to 7, how well did the partieipants aet as a team (and not as 
individuals)? Please circle one number: 

1 2 3 4 5 6 7 

Not at all Very well 

16. On a seale of 1 to 7, how often did the squad leader request information from the 
squad? Please eirele one number: 

1 2 3 4 5 6 7 

Not at all Very often 

17. On a scale of 1 to 7, how often did the squad members provide information to the 
squad leader? Please circle one number: 

1 2 3 4 5 6 7 

Not at all Very often 


18. On a scale of 1 to 7, how strong (directive) was the squad leader? Please circle one 
number: 

1 2 3 4 5 6 7 

Not at all Very strong 


19. On a scale of 1 to 7, how often was the authority of the squad leader questioned? 
Please circle one number: 

1 2 3 4 5 6 7 

Not at all Very often 

Area for notes: _ 
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20. On a scale of 1 to 7, how much trust did the squad leader have in the squad’s 
performanee and reports? Please cirele one number: 

1 2 3 4 5 6 7 

Not trust at all Very mueh trust 


21. On a seale of 1 to 7, how often did the squad wait for deeisions of the squad leader? 
Please eirele one number: 

1 2 3 4 5 6 7 

Not at all Very often 


22. On a scale of 1 to 7, how often did the squad have arguments on patrolling 
strategies? Please cirele one number: 

1 2 3 4 5 6 7 

Not at all Very often 


23. Did the squad leader use proper formations for the movement? Please cirele ‘YES’ or 


‘NO’: 


YES 


NO 


24. If eontaet was made with the enemy, did the squad leader take appropriate aetion? 
Please eirele ‘YES’ or ‘NO’: 


YES 


NO 


Section 3. Final Comments for Patrol #1; 


1. Any other eomments or suggestions: 

Comments: 


Suggestions: 


*** END of PATROL #1 EVALUATION *** 
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APPENDIX L—IIT STUDY SCHEDULES (EXPERIMENT 2) 

Master timeline sheets for IIT study 


Control Group 



Table 2. 


Control Group master timeline sheet for IIT study. 
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Treatment Group 


Master timeline sheet for pilot study. SUBJ ECTS: Control group (4 MAY - 8 MAY) 

GROUPS 


Action 

Time period 

Duration 

responsible 

Others Involved 
(helpers) 

Resources needed 

Note 

1 

2 

3 

4 

5 

6 


Recharge camera batteries 

Night before 


Craig 

, 

Batteries / chargers 

charge batteries 








Set up Squad Planning Operations 
Center (SPOC) 

0600 0730 

90 

Craig 

IIT staff 

all Items 








2 

Participants arrive 

0730 


Craig 

IIT staff 









3 

Issue consent forms 

0730 - 0800 

30 

Craig 

IIT Staffs 

Training unit 

Consent forms and 
pencils / pens 








4 

Ask Instructors how many 
scenarios the unit will go through 

0745 - 0800 

15 

Craig 

IIT staff 









5 

Brief and provide Intel refresher 

0800-0815 

15 

Craig 

Training unit 

briefing slides 

ASK IF EVERYONE CAN SIT IN ON IT 
- ASK TO USE THE PROJECTOR 







6 




Craig 



Emphasize camera use and reporting 
procedure (reporting to unit leader and 
to higher command). 







7 

Make camera available to the unit 
« make sure unit appoints 1 

Marine to handle the camera 
(show how camera works) 

0815-0830 

15 


Training unit 

camera 

Have the Marine sign for the camera. 
Train someone as the 2d observer 







8 

Fill out questionnaires 

0830 0845 

15 

Craig 

Marines & 
Instructors 

questionnnaires 

Make sure the patrol is not the last 
iteration 







g 

COLLECT QUESTIONNAIRES 

TBD 

TBD 

Craig 

Marines 


collect pens and pencils too 







10 

Conduct patrol 0B45-0930 45 Craig Marines & notes and camera work with Intel Marine in SPOC 

Instructors 







11 

Fill out questionnaires 0930-1000 15 Craig Mannes & 

Instructors 

questionnnaires 

In final patrol unit will fill out the final 
questionnaire. 







12 

COLLECT QUESTIONNAIRES 

TBD 

TBD 

Craig 

Marines & 
Instructors 


collect pens and pencils too 







13 

TURN ON CAMCORDER 

TBD 

TBD 

Craig 



(use pre-labeled mlnIDV tape) 







14 

Before AAR 

TBD 

TBD 

Craig 

Marines 


Ask them to provide a report for intel 
representative 







15 

Before AAR 

TBD 

TBD 

Craig 

Marines 

laptop, paper 
notebooks, paper 
sheets 

As well as charts (this includes 
counting and collect camera pictures 
that unit made In given scenario. MAKE 
NOTES OF PICTURES IF UNABLE TO 
DOWNLOAD - RECORD BY 
SCENARIO. This is in place of unit 
making intel products themselves. 







16 

Before AAR 

TBD 

TBD 

Craig 

Marines 


Emphasize the Intel cycle and camera 
use as part of the intel cycle 







17 

Count and collect camera 
pictures; as well as charts that 
unit made in given scenario. 

TBD 

TBD 

Craig 

Training unit 

camera & laptop 








18 

Conduct AAR (by instructor) - 
Important to be done AFTER they 
filled In their questionnaire. 

Record AAR with camcorder. 

TBD 

TBD 

Craig 

Marines & 
Instructors 

camcorder & video 

LABEL video tapes 







19 

TURN OFF CAMCORDER TBD TBD Craig 








Table 3. Treatment Group master timeline sheet for IIT study. 
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